-- Logs begin at Tue 2021-11-23 13:36:04 UTC, end at Tue 2021-11-23 14:56:55 UTC. -- Nov 23 14:21:56.117844 dv-cinder-804757-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 23 14:21:56.127533 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 23 14:21:56.129863 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 23 14:21:56 2021] *** Nov 23 14:21:56.129863 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 23 14:21:56.129863 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 23 14:21:56.129863 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: nodename: dv-cinder-804757-10-iscsi Nov 23 14:21:56.129863 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: machine: x86_64 Nov 23 14:21:56.129863 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: clock source: unix Nov 23 14:21:56.129863 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: pcre jit disabled Nov 23 14:21:56.129863 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: detected number of CPU cores: 4 Nov 23 14:21:56.129863 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: current working directory: / Nov 23 14:21:56.129863 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: detected binary path: /usr/bin/uwsgi-core Nov 23 14:21:56.129863 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: your processes number limit is 47680 Nov 23 14:21:56.129863 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: your memory page size is 4096 bytes Nov 23 14:21:56.131248 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: detected max file descriptor number: 2048 Nov 23 14:21:56.131248 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: lock engine: pthread robust mutexes Nov 23 14:21:56.131248 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: thunder lock: enabled Nov 23 14:21:56.131248 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 23 14:21:56.131248 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 23 14:21:56.174274 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: Python main interpreter initialized at 0x56415c6b09c0 Nov 23 14:21:56.174274 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: python threads support enabled Nov 23 14:21:56.174274 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: your server socket listen backlog is limited to 100 connections Nov 23 14:21:56.174274 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: your mercy for graceful operations on workers is 90 seconds Nov 23 14:21:56.174615 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: mapped 403077 bytes (393 KB) for 2 cores Nov 23 14:21:56.174711 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: *** Operational MODE: preforking *** Nov 23 14:21:56.174939 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: *** uWSGI is running in multiple interpreter mode *** Nov 23 14:21:56.174939 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: spawned uWSGI master process (pid: 102368) Nov 23 14:21:56.175132 dv-cinder-804757-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 23 14:21:56.175871 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: spawned uWSGI worker 1 (pid: 102369, cores: 1) Nov 23 14:21:56.176007 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: spawned uWSGI worker 2 (pid: 102370, cores: 1) Nov 23 14:21:56.176161 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 23 14:21:57.773003 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 14:21:57.773003 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: from cryptography.utils import int_from_bytes Nov 23 14:21:57.773664 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 14:21:57.773664 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: from cryptography.utils import int_from_bytes Nov 23 14:21:57.799350 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 14:21:57.799350 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: from cryptography.utils import int_from_bytes Nov 23 14:21:57.799868 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 14:21:57.799868 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: from cryptography.utils import int_from_bytes Nov 23 14:22:00.263496 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 14:22:00.264212 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 14:22:00.264212 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 14:22:00.264624 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 14:22:00.264878 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 14:22:00.265264 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.265587 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.265905 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.266223 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.266548 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.266864 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.267185 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.267278 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 14:22:00.267634 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 14:22:00.267720 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.267808 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.267928 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 14:22:00.268077 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.268307 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 14:22:00.268418 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.268566 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 14:22:00.268689 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804757-10-iscsi {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.268951 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.269046 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.269275 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.269368 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.269596 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.269681 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.269910 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.270006 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.270211 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.270304 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.270528 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.270611 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.270829 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.270925 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.271816 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.272042 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.272140 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.273138 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.273248 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.273330 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.273397 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.273397 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.273525 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804757-10-iscsi {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.273525 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.273649 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.273715 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.273778 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.273929 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.274012 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.274218 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.274356 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.274521 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.274659 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.274840 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.274965 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.275141 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.275276 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.275536 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804757-10-iscsi {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.275663 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.275853 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.275981 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.276166 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.276325 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.276510 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.276634 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.276892 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.277032 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.277208 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.277344 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.277523 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.277656 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.277865 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.278009 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.278133 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.278261 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.278462 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.278601 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.278734 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.278865 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.279071 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.279206 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804757-10-iscsi {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.279391 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.279518 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.279710 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.279845 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.280011 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.280143 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.280341 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.280487 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.280652 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.280791 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.280971 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.281104 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.281276 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.281402 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.281578 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.281713 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.281837 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.281967 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.282121 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.282248 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.282441 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.282581 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.282760 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.282887 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.283081 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.283219 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.283356 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.283481 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.283611 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.283762 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.283961 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.284135 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.284289 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.284427 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.284602 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.284737 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.284912 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.285047 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.285219 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.285352 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.285525 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.285650 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.285829 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.285963 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.286135 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.286267 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.286440 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.286566 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.286703 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.287415 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.287576 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.287708 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.287880 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.288043 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.288183 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.288331 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.288455 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.288659 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.288796 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.288922 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.289054 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.289281 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.289409 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.289532 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.289655 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.289831 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.289960 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.290168 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.290302 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.290479 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.290605 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.290785 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.290923 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.291101 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.291234 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.291419 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.291544 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.291725 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.291850 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.292029 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.292162 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.292358 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.292486 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.292676 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.292811 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.292994 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.293188 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.293322 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.293445 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.293576 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.293700 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.293821 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.293943 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.294109 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.294279 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.294426 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.294551 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.294732 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.294857 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.295038 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.295177 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.295343 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.295467 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.295640 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.295766 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.295946 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.296082 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.296291 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.296422 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.296630 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.296774 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.296905 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.297041 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.297170 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.297294 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.297463 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.297588 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.297766 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.297899 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.298058 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.298181 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.298362 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.298488 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.298707 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.298850 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.298973 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.299135 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.299266 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.299450 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.299585 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.299758 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.299882 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.300066 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.300190 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.300398 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.300534 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.300704 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.300837 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.301011 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.301135 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.301315 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.301450 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.301621 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.301745 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.301921 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.302052 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.302235 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.302375 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.302553 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.302733 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.302901 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.303147 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.303353 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.303480 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.303604 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.303734 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.303870 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.304001 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.304126 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.304300 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.304428 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.304562 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.304687 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.304809 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.304939 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.305063 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.305238 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.305365 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.305557 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.305691 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.305866 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.305994 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.306173 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.306298 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.306492 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.306625 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.306790 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.306915 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.307093 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.307217 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.307410 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.307537 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.307716 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.307842 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.308019 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.308143 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.308346 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.308484 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.308652 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.308793 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.308985 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.309118 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.309241 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.309372 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.309532 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.309658 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.309833 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.309959 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.310133 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.310268 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.310451 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.310576 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.310769 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.310895 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.311077 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.311215 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.311384 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.311509 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.311689 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.311822 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.312006 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:22:00.312140 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.312364 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.312492 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.312683 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.312807 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.313002 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.313136 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.313318 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.313443 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.313645 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.313770 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.313959 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.314086 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.314274 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.314400 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.314584 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.314716 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.314898 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.315027 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.315222 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.315354 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.315539 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.315679 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.315850 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.315977 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.316159 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.316326 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.316501 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.316627 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.316819 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.316946 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.317148 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.317275 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.317464 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.317599 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.317777 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.317904 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.318194 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.318329 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.318539 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.318675 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.318860 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.318999 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.319189 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.319318 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.319498 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.319634 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.319808 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.319935 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.320149 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.320294 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.320512 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.320655 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.320821 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.320947 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.321137 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.321262 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.321446 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.321580 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.321753 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.321879 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.322060 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.322187 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.322369 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.322495 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.322671 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.322804 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.322990 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.323109 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.323301 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.323427 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.323606 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.323902 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.324033 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.324157 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.324316 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.324443 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.324568 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.324691 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.324848 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.325051 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.325184 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.325317 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.325441 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.325566 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.325745 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.325881 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.326045 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.326177 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.326363 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.326491 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.326669 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.326807 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.326974 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.327101 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.327294 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.327426 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.327597 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.327732 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.327898 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.328024 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.328205 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.328394 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.328528 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.328653 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.328829 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.328956 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.329138 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.329354 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.329494 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.329624 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.329750 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.329879 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.330044 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.330171 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.330349 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.330477 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.330671 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.330799 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.330976 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.331110 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.331279 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.331413 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.331593 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.331720 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.331903 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.332040 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.332204 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.332356 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.332537 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.332664 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.332843 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.332978 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.333147 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.333280 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.333449 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.333589 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.334375 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.334849 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.334849 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.335106 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.335232 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.335355 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.335478 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.335614 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.335739 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.335862 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.335984 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.336108 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.336269 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.336396 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.336519 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.336655 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.336781 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.336911 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.337045 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.337171 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.337294 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.337418 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.337540 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.337670 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.337850 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.337978 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.338188 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.338315 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.338524 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.338659 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.338840 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.338969 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.339144 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.339271 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.339476 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.339611 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.339761 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.339901 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.340061 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.340186 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.340391 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.340537 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.340696 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.340823 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.341003 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.341135 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.341322 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.341458 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.341633 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.341760 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.341951 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.342078 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.342261 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.342396 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.342583 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.342711 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.342892 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.343019 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.343206 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.343339 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.343509 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.343634 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.343821 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.343952 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.344132 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.344282 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.344466 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.344605 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.344784 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.344912 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.345096 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.345236 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.345405 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.345537 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.345719 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.345846 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.346029 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.346156 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.346340 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.346491 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.346628 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.346775 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.346943 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.347077 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.347257 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.347384 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.347563 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.347699 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.347885 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.348019 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.348193 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.348387 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.348534 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.348675 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.348843 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.348977 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.349158 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.350067 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.350274 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.350412 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.350538 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.350667 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.350783 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.350912 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.351036 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.351171 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.351340 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.351467 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.351649 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.351776 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.351967 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.352102 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.352298 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.352443 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.352621 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.352749 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.352932 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.353058 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.353237 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.353364 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.353538 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.353665 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.353847 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.353974 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.354157 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.354304 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.354466 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.354593 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.354764 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.354892 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.355065 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.355192 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.355379 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.355507 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.355685 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.355812 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.355987 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.356113 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.356296 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.356436 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.356608 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.356734 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.356909 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.357035 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.357221 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.357361 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.357534 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.357667 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.357841 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.357975 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.358147 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.358281 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.358447 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.358580 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.358760 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.358886 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.359066 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.359201 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.359368 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.359496 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.359666 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.359797 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.359965 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.360092 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.360322 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.360460 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.360596 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.360720 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.360921 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.361049 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.361235 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.361361 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.361537 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.361662 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.361849 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.361975 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.362160 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.362294 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.362469 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.362596 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.362776 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.362911 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.363094 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.363221 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.363405 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.363534 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.363713 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.363826 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.364505 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.364653 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.364761 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.364875 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.365010 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.365129 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.365246 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.365586 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.365586 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.365804 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.365917 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.366028 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.366134 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.366237 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.366378 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.366501 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.366702 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.366820 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.367015 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.367134 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.367324 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.367436 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.367636 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.367900 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.368012 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.368258 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.368386 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.368571 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.368684 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.368886 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.369005 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.369197 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.369319 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.369505 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.369625 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.369815 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.369927 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.370117 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.370238 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.370437 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.370566 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.370738 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.370849 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.371492 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.371602 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.371708 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.371823 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.371936 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.371936 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.372142 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.372270 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.372409 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.372516 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.372630 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.372822 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.372937 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.373134 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.373248 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.373437 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.373557 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.373741 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.373872 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.374087 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.374215 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.374395 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.374529 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.374700 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.374841 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.375002 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.375128 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.375310 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.375435 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.375613 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.375751 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.375920 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.376045 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.376225 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.376373 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.376550 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.376677 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.376851 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.376986 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.377151 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.377277 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.377493 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.377621 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.377797 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.377925 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.378139 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.378277 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.378467 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.378609 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.378808 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.378935 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.379110 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.379241 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.379412 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.379547 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.379728 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.379852 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.380030 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.380156 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.380423 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.380757 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.380757 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.380999 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.381124 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.381255 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.381388 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.381512 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.381641 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.381766 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.381948 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.382074 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.382292 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.382420 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.382598 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.382725 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.382904 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.383034 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.383255 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.383394 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.383508 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.383622 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.383807 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.383948 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.384111 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.384259 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.384447 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.384583 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.384749 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.384889 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.385049 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.385174 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.385357 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.385494 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.385663 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.385797 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.385963 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.386089 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.386268 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.386394 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.386566 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.386700 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.386871 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.386997 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.387173 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.387308 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.387477 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.387617 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.387781 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.387909 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.388080 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.388206 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.388412 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.388552 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.388714 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.388841 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.389020 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.389154 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.389321 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.389449 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.389623 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.389750 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.389921 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.390047 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.390226 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.390353 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.390527 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.390653 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.390863 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.390990 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.391127 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.391251 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.391411 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.391557 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.391716 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.391851 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.392015 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.392142 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.392356 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.392490 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.392659 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.392952 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.392952 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.393237 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.393237 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.393522 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.393656 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.393784 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.393916 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.394042 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.394166 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.394338 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.394465 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.394599 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.394724 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.394848 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.394972 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.395154 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.395291 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.395458 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.395590 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.395767 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.395897 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.396075 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.396802 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.397077 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.397215 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.397385 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.397511 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.397696 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.397831 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.397998 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.398161 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.398287 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.398410 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.398592 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.398729 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.398896 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.399025 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.399198 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.399325 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.399520 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.399648 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.399828 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.399963 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.400132 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.400278 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.400480 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.400607 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.400731 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.400869 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.401061 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.401187 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.401346 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.401475 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.401650 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.401785 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.401968 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.402097 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.402278 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.402406 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.402588 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.402715 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.402897 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.403022 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.403207 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.403342 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.403521 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.403648 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.403820 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.403958 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.404127 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.404287 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.404459 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.404587 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.404767 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.404902 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.405070 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.405205 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.405374 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.405501 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.405680 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.405818 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.405991 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.406116 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.406298 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.406423 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.406607 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.406754 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.406918 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.407044 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.407222 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.407351 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.407550 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.407675 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.407821 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.407958 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.408121 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.408274 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.408452 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.408586 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.408767 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.408900 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.409070 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.409197 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.409377 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.409506 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.409680 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.409807 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.409989 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.410115 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.410291 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.410419 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.410675 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.410803 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.410982 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.411195 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.411323 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.411447 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.411572 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.411696 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.412539 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.412688 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.412826 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.412952 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.413075 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.413226 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.413353 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.413486 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.413656 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.413784 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.413961 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.414116 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.414271 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.414411 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.414576 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.414717 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.415002 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.415129 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.415306 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.415440 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.415608 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.415737 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.415910 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.416037 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.416221 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.416373 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.416545 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.416671 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.416848 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.416987 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.417152 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.417288 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.417453 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.417579 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.417762 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.417897 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.418083 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.418212 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.418463 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.418596 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.418774 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.418912 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.419079 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.419214 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.419382 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.419510 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.419695 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.419831 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.420017 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.420145 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.420329 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.420457 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.420640 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.420776 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.420944 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.421073 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.421279 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.421422 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.421560 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.421693 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.421869 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.422014 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.422218 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.422351 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.422541 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.422669 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.422850 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.422977 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.423164 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.423293 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.423467 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.423595 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.423787 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.423917 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.424106 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.424265 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.424436 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.424623 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.424751 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.424950 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.425145 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.425274 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.425468 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.425608 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.425777 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.425905 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.426093 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.426235 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.426418 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.426546 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.426723 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.426851 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.427025 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.427166 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.427333 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.427579 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.427728 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.427890 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.428113 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.428272 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.428450 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.428586 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.428725 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.428851 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.428975 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.429206 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.429341 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.429514 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.429649 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.429814 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.429943 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.430116 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.430244 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.430436 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.430611 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.430739 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.430863 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.431028 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.431164 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.431389 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.431533 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.431659 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.431790 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.431916 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.432047 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.432231 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.432382 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.432556 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.432696 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.432868 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.433004 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.433171 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.433301 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.433474 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.433650 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.433784 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.433924 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.434063 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.434183 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.434384 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.434512 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.434685 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.434823 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.435006 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.435135 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.435320 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.435448 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.435628 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.435757 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.435951 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.436078 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.436290 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.436444 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.436602 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.436732 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.436911 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.437037 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.437217 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.437346 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.437523 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.437651 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.437823 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.437950 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.438129 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.438264 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.438437 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.438566 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.438737 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.438868 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.439037 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.439173 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.439344 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.439479 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.439644 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.439779 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.439944 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.440103 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.440249 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.440459 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.440598 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.440775 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.440952 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.441087 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.441213 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.441399 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.441606 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.441734 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.441870 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.442003 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.442128 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.442288 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.442416 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.442592 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.442728 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.442896 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.443095 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.443322 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.443500 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.443675 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.443812 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.443937 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.444106 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.444293 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.444439 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.444571 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.444707 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.444894 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.445021 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.445209 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.445335 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.445522 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.445652 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.445835 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.445961 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.446149 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.446278 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.446465 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.446593 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.446777 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.446903 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.447090 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.447218 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.447384 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.447511 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.447697 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.447824 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.448011 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.448137 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.448353 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.448482 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.448678 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.448881 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.449008 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.449210 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.449347 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.449526 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.449655 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.449842 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.449970 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.450155 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.450284 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.450471 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.450600 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.450785 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.450913 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.451095 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.451224 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.451405 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.451532 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.451739 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.451866 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.452004 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.452136 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.452341 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.452472 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.452658 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.452799 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.452982 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.453177 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.453310 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.453505 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.453644 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.453818 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.453948 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.454130 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.454267 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.454434 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.454552 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.454868 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.455074 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.455186 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.455360 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.455489 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.455777 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.455913 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.456091 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.456220 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.456426 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.456554 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.456738 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.456867 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.457051 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.457179 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.457365 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.457600 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.457735 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.457868 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.457994 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.458118 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.458260 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.458395 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.458574 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.459221 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.459432 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.459602 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.459849 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.459987 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.460190 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.460353 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.460538 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.460667 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.460853 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.460990 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.461168 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.461301 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.461481 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.461608 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.461826 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.461997 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.462126 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.462311 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.462440 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.462640 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.462767 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.462959 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.463087 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.463282 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.463410 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.463589 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.463717 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.463904 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.464031 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.464214 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.464361 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.464548 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.464685 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.464853 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.464982 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.465164 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.465298 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.465474 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.465603 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.465778 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.465907 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.466092 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.466232 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.466400 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.466612 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.466742 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.466924 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.467059 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.467251 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.467390 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.467573 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.467820 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.467948 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.468170 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.468359 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.468512 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.468641 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.468836 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.468962 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.469140 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.469278 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.469444 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.469572 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.469753 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.469881 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.470060 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.470188 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.470364 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.470493 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.470668 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.470795 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.470982 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.471108 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.471291 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.471418 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.471594 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.471722 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.471903 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.472031 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.472216 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.472543 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.472634 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.472847 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.472937 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.473156 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.473243 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.473459 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.473546 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.473784 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.473882 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.474088 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.474184 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.475088 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.475221 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.475441 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.475537 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.475618 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.475739 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.475859 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.476047 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.476165 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.476388 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.476490 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.476707 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.476795 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.477012 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.477108 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.477318 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.477405 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.477631 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.477719 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.477942 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.478032 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.478243 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.478331 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.478544 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.478630 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.478844 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.478932 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.479147 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.479232 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.479461 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.479554 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.479765 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.479852 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.480064 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.480150 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.480401 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.480493 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.480705 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.480793 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.481009 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.481097 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.481314 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.481413 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.481616 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.481702 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.481926 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.482014 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.482228 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.482333 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.482537 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.482772 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.482862 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.483132 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.483229 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.483432 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.483520 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.483739 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.483825 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.484040 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.484132 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.484383 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.484474 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.484687 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.484773 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.484989 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.485101 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.485330 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.485411 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.485598 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.485693 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.485905 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.486002 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.486216 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.486303 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.486524 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.486612 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.486832 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.486993 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.487140 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.487312 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.487447 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.487754 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.487848 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.488064 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.488202 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.488401 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.488546 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.488744 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.488887 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.489064 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.489226 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.489382 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.489532 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.489697 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.489836 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.490080 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.490332 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.490435 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.490568 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.490740 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.490880 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.491052 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.491190 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.491360 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.491500 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.491673 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.491808 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.492001 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.492116 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.492338 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.492437 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.492643 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.492740 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.493040 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.493126 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.493349 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.493438 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.493660 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.493752 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.493975 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.494069 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.494283 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.494380 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.494604 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.494693 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.494918 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.495005 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.495238 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.495487 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.495581 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.495671 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.495827 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.495923 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.496132 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.496254 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.496484 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.496585 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.496799 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.496886 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.497121 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.497208 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.497426 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.497513 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.497728 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.497813 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.498028 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.498147 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.498336 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.498460 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.498664 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.498778 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.498996 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.499091 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.499309 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.499396 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.499629 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.499725 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.499938 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.500044 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.500274 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.500367 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.500584 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.500687 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.500902 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.500990 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.501220 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.501307 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.501533 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.501629 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.501839 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.501927 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.502167 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.502253 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.502474 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.502574 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.502776 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.502864 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.503080 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.503168 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.503387 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.503480 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.503694 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.503793 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.504001 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.504089 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.504353 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.504444 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.504675 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.504777 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.504977 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.505063 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.505297 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.505459 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.505676 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.505764 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.505940 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.506202 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.506288 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.506368 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.506570 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.506665 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.506879 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.506976 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.507208 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.507296 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.507518 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.507653 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.507824 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.507920 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.508134 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.508221 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.508467 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.508555 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.508775 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.508879 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.509085 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.509173 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.509408 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.509494 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.509729 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.509816 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.510035 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.510133 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.510359 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.510452 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.510676 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.510772 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.510997 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.511087 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.511313 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.511402 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.511625 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.511712 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.511935 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.512024 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.512264 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.512371 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.512496 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 14:22:00.512590 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.512873 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.513185 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.513549 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.513817 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.514141 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.514467 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.514793 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.515119 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.515472 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.515774 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.516113 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.516481 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.516797 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.517110 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.517416 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:22:00.517659 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 14:22:00.535750 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG oslo_db.sqlalchemy.engines [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 14:22:00.541215 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_db.sqlalchemy.engines [None req-9ce38c50-67c5-4cbc-b8b7-09560566ac16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 14:22:00.603718 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.context [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0b6352a7-9cca-435b-bdd7-4cf12ee239c0(cell1) {{(pid=102370) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 14:22:00.607527 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.context [None req-9ce38c50-67c5-4cbc-b8b7-09560566ac16 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0b6352a7-9cca-435b-bdd7-4cf12ee239c0(cell1) {{(pid=102369) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 14:22:00.607924 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG oslo_concurrency.lockutils [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:22:00.609522 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG oslo_concurrency.lockutils [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:22:00.610313 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG oslo_concurrency.lockutils [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:22:00.611708 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-9ce38c50-67c5-4cbc-b8b7-09560566ac16 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:22:00.612228 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG oslo_concurrency.lockutils [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:22:00.613303 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-9ce38c50-67c5-4cbc-b8b7-09560566ac16 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:22:00.614096 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-9ce38c50-67c5-4cbc-b8b7-09560566ac16 None None] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:22:00.616027 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-9ce38c50-67c5-4cbc-b8b7-09560566ac16 None None] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:22:00.622337 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG oslo_db.sqlalchemy.engines [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 14:22:00.623541 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG oslo_db.sqlalchemy.engines [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 14:22:00.628514 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_db.sqlalchemy.engines [None req-9ce38c50-67c5-4cbc-b8b7-09560566ac16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 14:22:00.634680 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_db.sqlalchemy.engines [None req-9ce38c50-67c5-4cbc-b8b7-09560566ac16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 14:22:00.880143 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG oslo_db.sqlalchemy.engines [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 14:22:00.890659 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_db.sqlalchemy.engines [None req-9ce38c50-67c5-4cbc-b8b7-09560566ac16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 14:22:01.360997 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: WARNING keystonemiddleware.auth_token [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 14:22:01.369670 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: WARNING keystonemiddleware.auth_token [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 14:22:01.470963 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: WARNING keystonemiddleware.auth_token [None req-9ce38c50-67c5-4cbc-b8b7-09560566ac16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 14:22:01.478245 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: WARNING keystonemiddleware.auth_token [None req-9ce38c50-67c5-4cbc-b8b7-09560566ac16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 14:22:01.591910 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: WARNING keystonemiddleware.auth_token [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 14:22:01.597050 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: WARNING keystonemiddleware.auth_token [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 14:22:01.602391 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56415c6b09c0 pid: 102370 (default app) Nov 23 14:22:01.604455 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:22:01.605615 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] 10.222.0.82 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001731 Nov 23 14:22:01.606010 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 1/1] 10.222.0.82 () {50 vars in 788 bytes} [Tue Nov 23 14:22:01 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:22:01.710573 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: WARNING keystonemiddleware.auth_token [None req-9ce38c50-67c5-4cbc-b8b7-09560566ac16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 14:22:01.715773 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: WARNING keystonemiddleware.auth_token [None req-9ce38c50-67c5-4cbc-b8b7-09560566ac16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 14:22:01.721149 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56415c6b09c0 pid: 102369 (default app) Nov 23 14:23:24.971991 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:23:24.973826 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Nov 23 14:23:24.974318 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 2/2] 10.222.0.82 () {54 vars in 930 bytes} [Tue Nov 23 14:23:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:23:25.552393 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-c9eda93a-cbfc-4c99-9001-a7cd1b5f44bc admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:23:25.584261 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-c9eda93a-cbfc-4c99-9001-a7cd1b5f44bc admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.602684 Nov 23 14:23:25.585040 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 1/3] 10.222.0.82 () {60 vars in 1291 bytes} [Tue Nov 23 14:23:24 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:23:27.933444 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:23:27.934457 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-7de925bf-af0a-4b61-8be4-d80382735af2 None None] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Nov 23 14:23:27.934865 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 3/4] 10.222.0.82 () {54 vars in 930 bytes} [Tue Nov 23 14:23:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:23:27.995666 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-42f155f7-cd16-4b8f-bb19-b37bb5dbd45b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256", "vcpus": 1, "id": "c1", "rxtx_factor": 1.0}} {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:28.014654 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:23:28.014654 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: warnings.warn(msg) Nov 23 14:23:28.112153 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-42f155f7-cd16-4b8f-bb19-b37bb5dbd45b admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.170382 Nov 23 14:23:28.120328 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 2/5] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Nov 23 14:23:27 2021] POST /compute/v2.1/flavors => generated 407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:23:28.452321 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-6a7342aa-1f30-4528-9c04-ccd6c7a8d444 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:28.454682 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:23:28.454682 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: warnings.warn(msg) Nov 23 14:23:28.559732 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-6a7342aa-1f30-4528-9c04-ccd6c7a8d444 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.437680 Nov 23 14:23:28.560653 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 4/6] 10.222.0.82 () {64 vars in 1335 bytes} [Tue Nov 23 14:23:28 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:23:30.881480 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-42f155f7-cd16-4b8f-bb19-b37bb5dbd45b admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:23:30.882502 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-42f155f7-cd16-4b8f-bb19-b37bb5dbd45b admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Nov 23 14:23:30.882916 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 3/7] 10.222.0.82 () {54 vars in 930 bytes} [Tue Nov 23 14:23:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:23:30.994784 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-387b897f-8f92-4e97-81dd-3de25818acaf admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "vcpus": 1, "disk": 5, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:31.014858 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:23:31.014858 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: warnings.warn(msg) Nov 23 14:23:31.104583 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-387b897f-8f92-4e97-81dd-3de25818acaf admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.214507 Nov 23 14:23:31.105413 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 5/8] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Nov 23 14:23:30 2021] POST /compute/v2.1/flavors => generated 404 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:23:31.119186 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-6933cf66-fc71-414c-adf6-ba303cc5804a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:31.120787 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:23:31.120787 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: warnings.warn(msg) Nov 23 14:23:31.210314 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-6933cf66-fc71-414c-adf6-ba303cc5804a admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094934 Nov 23 14:23:31.210954 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 4/9] 10.222.0.82 () {64 vars in 1335 bytes} [Tue Nov 23 14:23:31 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:23:33.527671 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-387b897f-8f92-4e97-81dd-3de25818acaf admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:23:33.528758 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-387b897f-8f92-4e97-81dd-3de25818acaf admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Nov 23 14:23:33.532414 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 6/10] 10.222.0.82 () {54 vars in 930 bytes} [Tue Nov 23 14:23:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:23:33.591416 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-c0fcc3a8-9554-4558-a2c4-c00c496c68f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "name": "ds1G"}} {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:33.674883 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-c0fcc3a8-9554-4558-a2c4-c00c496c68f1 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139085 Nov 23 14:23:33.675473 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 5/11] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Nov 23 14:23:33 2021] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:23:33.691484 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-1026d577-4d0e-49c6-a1ab-09a1c5e77d54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:33.771335 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-1026d577-4d0e-49c6-a1ab-09a1c5e77d54 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086366 Nov 23 14:23:33.776793 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 7/12] 10.222.0.82 () {64 vars in 1335 bytes} [Tue Nov 23 14:23:33 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:23:36.093464 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-c0fcc3a8-9554-4558-a2c4-c00c496c68f1 admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:23:36.094616 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-c0fcc3a8-9554-4558-a2c4-c00c496c68f1 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Nov 23 14:23:36.095097 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 6/13] 10.222.0.82 () {54 vars in 930 bytes} [Tue Nov 23 14:23:36 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:23:36.153065 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-92bab6a6-adae-4259-8537-1061841dda0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:36.205922 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-92bab6a6-adae-4259-8537-1061841dda0f admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.104271 Nov 23 14:23:36.206832 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 8/14] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Nov 23 14:23:36 2021] POST /compute/v2.1/flavors => generated 404 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:23:36.218723 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-999c11e7-cd9b-45a0-9ef4-f926a0e501ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:36.287213 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-999c11e7-cd9b-45a0-9ef4-f926a0e501ca admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071999 Nov 23 14:23:36.287809 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 7/15] 10.222.0.82 () {64 vars in 1335 bytes} [Tue Nov 23 14:23:36 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:23:38.679811 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-92bab6a6-adae-4259-8537-1061841dda0f admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:23:38.680842 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-92bab6a6-adae-4259-8537-1061841dda0f admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Nov 23 14:23:38.681439 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 9/16] 10.222.0.82 () {54 vars in 930 bytes} [Tue Nov 23 14:23:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:23:38.754495 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-7629e341-1626-4483-9a33-692f57c17056 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "vcpus": 4}} {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:38.841539 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-7629e341-1626-4483-9a33-692f57c17056 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153896 Nov 23 14:23:38.842132 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 8/17] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Nov 23 14:23:38 2021] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:23:38.854848 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-ca82f258-e879-4067-82c8-61350d185728 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:38.928857 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-ca82f258-e879-4067-82c8-61350d185728 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077717 Nov 23 14:23:38.929432 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 10/18] 10.222.0.82 () {64 vars in 1335 bytes} [Tue Nov 23 14:23:38 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:23:41.256363 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-7629e341-1626-4483-9a33-692f57c17056 admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:23:41.257619 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-7629e341-1626-4483-9a33-692f57c17056 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001945 Nov 23 14:23:41.258184 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 9/19] 10.222.0.82 () {54 vars in 930 bytes} [Tue Nov 23 14:23:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:23:41.318034 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-8045470e-84af-45af-9262-d2a8c92e72aa admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:23:41.342727 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-8045470e-84af-45af-9262-d2a8c92e72aa admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076147 Nov 23 14:23:41.343301 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 11/20] 10.222.0.82 () {60 vars in 1291 bytes} [Tue Nov 23 14:23:41 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:23:43.636757 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-7629e341-1626-4483-9a33-692f57c17056 admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:23:43.637872 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-7629e341-1626-4483-9a33-692f57c17056 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Nov 23 14:23:43.638279 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 10/21] 10.222.0.82 () {54 vars in 930 bytes} [Tue Nov 23 14:23:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:23:43.699004 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-c4f17363-1b98-4412-a22b-175608b227f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "id": "1", "ram": 512}} {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:43.806528 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-c4f17363-1b98-4412-a22b-175608b227f8 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.161856 Nov 23 14:23:43.807079 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 12/22] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Nov 23 14:23:43 2021] POST /compute/v2.1/flavors => generated 402 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:23:43.820852 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-667859b7-eca4-4294-9db7-e6e6eaf298ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:43.913236 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-667859b7-eca4-4294-9db7-e6e6eaf298ec admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097219 Nov 23 14:23:43.913828 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 11/23] 10.222.0.82 () {64 vars in 1332 bytes} [Tue Nov 23 14:23:43 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:23:46.272462 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-c4f17363-1b98-4412-a22b-175608b227f8 admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:23:46.273464 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-c4f17363-1b98-4412-a22b-175608b227f8 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Nov 23 14:23:46.273895 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 13/24] 10.222.0.82 () {54 vars in 930 bytes} [Tue Nov 23 14:23:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:23:46.333290 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-8a69f8a2-48db-4e76-82da-83e6dba456ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 20}} {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:46.394310 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-8a69f8a2-48db-4e76-82da-83e6dba456ed admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.113924 Nov 23 14:23:46.397700 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 12/25] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Nov 23 14:23:46 2021] POST /compute/v2.1/flavors => generated 405 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:23:46.407662 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-4e313b67-c017-4128-b151-01d4c0b342d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:46.466870 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-4e313b67-c017-4128-b151-01d4c0b342d2 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062872 Nov 23 14:23:46.467812 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 14/26] 10.222.0.82 () {64 vars in 1332 bytes} [Tue Nov 23 14:23:46 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:23:48.796063 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-8a69f8a2-48db-4e76-82da-83e6dba456ed admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:23:48.797133 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-8a69f8a2-48db-4e76-82da-83e6dba456ed admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Nov 23 14:23:48.798406 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 13/27] 10.222.0.82 () {54 vars in 930 bytes} [Tue Nov 23 14:23:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:23:48.855833 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-7ae2710b-7cc1-458e-bdbb-940d45a5fd2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "id": "3", "swap": 0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:48.932845 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-7ae2710b-7cc1-458e-bdbb-940d45a5fd2f admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.128312 Nov 23 14:23:48.933650 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 15/28] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Nov 23 14:23:48 2021] POST /compute/v2.1/flavors => generated 406 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:23:48.947406 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-8af4484f-d81b-440f-9380-75f5d9e6b571 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:49.034560 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-8af4484f-d81b-440f-9380-75f5d9e6b571 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091019 Nov 23 14:23:49.035143 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 14/29] 10.222.0.82 () {64 vars in 1332 bytes} [Tue Nov 23 14:23:48 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:23:51.531786 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-7ae2710b-7cc1-458e-bdbb-940d45a5fd2f admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:23:51.533289 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-7ae2710b-7cc1-458e-bdbb-940d45a5fd2f admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 Nov 23 14:23:51.533695 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 16/30] 10.222.0.82 () {54 vars in 930 bytes} [Tue Nov 23 14:23:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:23:51.603276 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-086a9f37-dd9b-4c9c-a275-1ae23c7481f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 8192, "swap": 0, "id": "4", "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0, "name": "m1.large"}} {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:51.692878 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-086a9f37-dd9b-4c9c-a275-1ae23c7481f1 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.151557 Nov 23 14:23:51.693860 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 15/31] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Nov 23 14:23:51 2021] POST /compute/v2.1/flavors => generated 405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:23:51.706482 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-db94bdfa-9b6c-4d7a-be50-90248ca6f068 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:51.781521 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-db94bdfa-9b6c-4d7a-be50-90248ca6f068 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078836 Nov 23 14:23:51.782260 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 17/32] 10.222.0.82 () {64 vars in 1332 bytes} [Tue Nov 23 14:23:51 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:23:54.106590 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-086a9f37-dd9b-4c9c-a275-1ae23c7481f1 admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:23:54.108207 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-086a9f37-dd9b-4c9c-a275-1ae23c7481f1 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002056 Nov 23 14:23:54.108873 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 16/33] 10.222.0.82 () {54 vars in 930 bytes} [Tue Nov 23 14:23:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:23:54.171246 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-756b2b2c-4f0e-447f-aedc-c40626d5b180 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "vcpus": 8, "rxtx_factor": 1.0, "disk": 160, "swap": 0}} {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:54.234757 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-756b2b2c-4f0e-447f-aedc-c40626d5b180 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.119299 Nov 23 14:23:54.235412 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 18/34] 10.222.0.82 () {64 vars in 1282 bytes} [Tue Nov 23 14:23:54 2021] POST /compute/v2.1/flavors => generated 408 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:23:54.248219 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-61e4f80e-5f2c-4f43-b25a-254623f4b620 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:23:54.350538 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-61e4f80e-5f2c-4f43-b25a-254623f4b620 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105268 Nov 23 14:23:54.351745 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 17/35] 10.222.0.82 () {64 vars in 1332 bytes} [Tue Nov 23 14:23:54 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:24:16.482864 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-756b2b2c-4f0e-447f-aedc-c40626d5b180 admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:16.483884 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-756b2b2c-4f0e-447f-aedc-c40626d5b180 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Nov 23 14:24:16.484308 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 19/36] 10.222.0.82 () {54 vars in 930 bytes} [Tue Nov 23 14:24:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:24:16.544767 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-73826066-9f7d-42ba-9670-90a38590b790 admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:16.561971 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-73826066-9f7d-42ba-9670-90a38590b790 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070637 Nov 23 14:24:16.562506 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 18/37] 10.222.0.82 () {60 vars in 1291 bytes} [Tue Nov 23 14:24:16 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:24:18.045187 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-756b2b2c-4f0e-447f-aedc-c40626d5b180 admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:18.046188 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-756b2b2c-4f0e-447f-aedc-c40626d5b180 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Nov 23 14:24:18.046591 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 20/38] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Nov 23 14:24:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:24:18.235579 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-695c7000-ef62-4e4a-8bf6-27f2d762ad9c admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:18.241065 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.wsgi [None req-695c7000-ef62-4e4a-8bf6-27f2d762ad9c admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 23 14:24:18.241797 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-695c7000-ef62-4e4a-8bf6-27f2d762ad9c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:24:18.242657 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-695c7000-ef62-4e4a-8bf6-27f2d762ad9c admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057343 Nov 23 14:24:18.243214 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 19/39] 10.222.0.82 () {60 vars in 1190 bytes} [Tue Nov 23 14:24:18 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 14:24:18.252939 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-36d1be99-18c8-47f7-b864-07ac7bb17fa5 admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:18.273607 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-36d1be99-18c8-47f7-b864-07ac7bb17fa5 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024196 Nov 23 14:24:18.274129 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 21/40] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Nov 23 14:24:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:24:18.284154 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-cdc88501-69b3-4760-92f0-4930efbf8d20 admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:18.305458 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-cdc88501-69b3-4760-92f0-4930efbf8d20 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024800 Nov 23 14:24:18.306000 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 20/41] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Nov 23 14:24:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:24:18.315542 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-e29f765a-3a88-492d-9827-649c20c46e01 admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:18.321035 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.wsgi [None req-e29f765a-3a88-492d-9827-649c20c46e01 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 23 14:24:18.321591 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-e29f765a-3a88-492d-9827-649c20c46e01 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:24:18.322363 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-e29f765a-3a88-492d-9827-649c20c46e01 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010330 Nov 23 14:24:18.322841 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 22/42] 10.222.0.82 () {60 vars in 1190 bytes} [Tue Nov 23 14:24:18 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 23 14:24:19.705542 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-cdc88501-69b3-4760-92f0-4930efbf8d20 admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:19.706600 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-cdc88501-69b3-4760-92f0-4930efbf8d20 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Nov 23 14:24:19.707649 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 21/43] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Nov 23 14:24:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:24:19.899301 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-a6715f4a-fcfe-42ec-b010-b7762782652e admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:19.904515 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.wsgi [None req-a6715f4a-fcfe-42ec-b010-b7762782652e admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 23 14:24:19.905073 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-a6715f4a-fcfe-42ec-b010-b7762782652e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:24:19.905845 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-a6715f4a-fcfe-42ec-b010-b7762782652e admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058180 Nov 23 14:24:19.906373 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 23/44] 10.222.0.82 () {60 vars in 1190 bytes} [Tue Nov 23 14:24:19 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 14:24:19.916882 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-31b036ac-f55f-48c2-8207-4385cfdf19e1 admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:19.930029 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-31b036ac-f55f-48c2-8207-4385cfdf19e1 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016678 Nov 23 14:24:19.930541 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 22/45] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Nov 23 14:24:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:24:19.940186 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-b325d723-d863-46f3-8b8e-d0060e9af91e admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:19.954401 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-b325d723-d863-46f3-8b8e-d0060e9af91e admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017618 Nov 23 14:24:19.954915 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 24/46] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Nov 23 14:24:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:24:19.965129 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-f0e692de-257a-41f0-b658-9a6958d2180d admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:19.970288 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.wsgi [None req-f0e692de-257a-41f0-b658-9a6958d2180d admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 23 14:24:19.970847 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-f0e692de-257a-41f0-b658-9a6958d2180d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:24:19.971614 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-f0e692de-257a-41f0-b658-9a6958d2180d admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009951 Nov 23 14:24:19.972092 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 23/47] 10.222.0.82 () {60 vars in 1190 bytes} [Tue Nov 23 14:24:19 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 14:24:21.355583 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-b325d723-d863-46f3-8b8e-d0060e9af91e admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:21.356638 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-b325d723-d863-46f3-8b8e-d0060e9af91e admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Nov 23 14:24:21.357041 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 25/48] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Nov 23 14:24:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:24:21.548754 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-01c30d16-674a-40b2-b111-00714072c2ff admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:21.554051 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.wsgi [None req-01c30d16-674a-40b2-b111-00714072c2ff admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 23 14:24:21.554627 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-01c30d16-674a-40b2-b111-00714072c2ff admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:24:21.555411 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-01c30d16-674a-40b2-b111-00714072c2ff admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059016 Nov 23 14:24:21.555909 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 24/49] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Nov 23 14:24:21 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 14:24:21.565582 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-07242c8c-d34b-40c6-a009-a7bbf16bf1d8 admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:21.579042 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-07242c8c-d34b-40c6-a009-a7bbf16bf1d8 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016974 Nov 23 14:24:21.579569 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 26/50] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Nov 23 14:24:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:24:21.590589 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-a1d9904e-82ec-44ff-a5b6-71410f4ddf1d admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:21.603485 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-a1d9904e-82ec-44ff-a5b6-71410f4ddf1d admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016810 Nov 23 14:24:21.604013 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 25/51] 10.222.0.82 () {60 vars in 1210 bytes} [Tue Nov 23 14:24:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:24:21.613716 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-91145fba-53f3-44d9-be7f-4dd7fb1e396c admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:21.618452 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.wsgi [None req-91145fba-53f3-44d9-be7f-4dd7fb1e396c admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 23 14:24:21.619012 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-91145fba-53f3-44d9-be7f-4dd7fb1e396c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:24:21.619791 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-91145fba-53f3-44d9-be7f-4dd7fb1e396c admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009842 Nov 23 14:24:21.620294 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 27/52] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Nov 23 14:24:21 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 14:24:22.999542 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-a1d9904e-82ec-44ff-a5b6-71410f4ddf1d admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:23.000652 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-a1d9904e-82ec-44ff-a5b6-71410f4ddf1d admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Nov 23 14:24:23.001047 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 26/53] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Nov 23 14:24:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:24:23.195826 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-90827224-7929-4ae6-9e33-ee3c73dcff37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:24:23.280332 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-90827224-7929-4ae6-9e33-ee3c73dcff37 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.136705 Nov 23 14:24:23.280870 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 28/54] 10.222.0.82 () {64 vars in 1235 bytes} [Tue Nov 23 14:24:23 2021] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:24:24.675955 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-a1d9904e-82ec-44ff-a5b6-71410f4ddf1d admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:24.676977 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-a1d9904e-82ec-44ff-a5b6-71410f4ddf1d admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Nov 23 14:24:24.677376 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 27/55] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Nov 23 14:24:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:24:24.868791 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-5ab54d41-370c-4a24-b889-b66750d81118 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:24:24.943292 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-5ab54d41-370c-4a24-b889-b66750d81118 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.124114 Nov 23 14:24:24.948458 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 29/56] 10.222.0.82 () {64 vars in 1235 bytes} [Tue Nov 23 14:24:24 2021] POST /compute/v2.1/flavors => generated 405 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:24:26.341482 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-a1d9904e-82ec-44ff-a5b6-71410f4ddf1d admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:26.342492 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-a1d9904e-82ec-44ff-a5b6-71410f4ddf1d admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Nov 23 14:24:26.342890 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 28/57] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Nov 23 14:24:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:24:26.536028 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-0469337b-51b0-4df8-af9f-2f0153fa16c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:24:26.605773 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-0469337b-51b0-4df8-af9f-2f0153fa16c4 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.121315 Nov 23 14:24:26.606266 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 30/58] 10.222.0.82 () {64 vars in 1235 bytes} [Tue Nov 23 14:24:26 2021] POST /compute/v2.1/flavors => generated 407 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:24:28.000220 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-a1d9904e-82ec-44ff-a5b6-71410f4ddf1d admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:28.001245 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-a1d9904e-82ec-44ff-a5b6-71410f4ddf1d admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Nov 23 14:24:28.001638 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 29/59] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Nov 23 14:24:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:24:28.201536 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-56ddffc6-d382-46f6-8eec-1ebe9a2c45a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:24:28.275109 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-56ddffc6-d382-46f6-8eec-1ebe9a2c45a6 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.126050 Nov 23 14:24:28.275569 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 31/60] 10.222.0.82 () {64 vars in 1235 bytes} [Tue Nov 23 14:24:28 2021] POST /compute/v2.1/flavors => generated 409 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:24:29.647220 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-a1d9904e-82ec-44ff-a5b6-71410f4ddf1d admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:29.648214 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-a1d9904e-82ec-44ff-a5b6-71410f4ddf1d admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001672 Nov 23 14:24:29.648638 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 30/61] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Nov 23 14:24:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:24:29.844786 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-c0cd22d8-6c95-4f6f-baba-905a6ae0ebf2 admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:24:29.864681 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-c0cd22d8-6c95-4f6f-baba-905a6ae0ebf2 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070454 Nov 23 14:24:29.865214 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 32/62] 10.222.0.82 () {60 vars in 1202 bytes} [Tue Nov 23 14:24:29 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:25:16.429568 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-a1d9904e-82ec-44ff-a5b6-71410f4ddf1d admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:25:16.430584 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-a1d9904e-82ec-44ff-a5b6-71410f4ddf1d admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Nov 23 14:25:16.430992 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 31/63] 10.222.0.82 () {54 vars in 930 bytes} [Tue Nov 23 14:25:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:25:16.489675 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-f4e1473c-0191-44ee-966f-41f5d5a97534 admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:25:16.508836 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-f4e1473c-0191-44ee-966f-41f5d5a97534 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071229 Nov 23 14:25:16.509375 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 33/64] 10.222.0.82 () {60 vars in 1291 bytes} [Tue Nov 23 14:25:16 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:25:16.531775 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-03120449-83a6-40e2-87e5-a05bbce00c93 admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:25:16.539406 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-03120449-83a6-40e2-87e5-a05bbce00c93 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011144 Nov 23 14:25:16.539929 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 32/65] 10.222.0.82 () {60 vars in 1282 bytes} [Tue Nov 23 14:25:16 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:25:16.552229 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-acfe1dcc-64e1-4eac-a9d3-d4b13410ea0f admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:25:16.559813 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-acfe1dcc-64e1-4eac-a9d3-d4b13410ea0f admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011821 Nov 23 14:25:16.560345 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 34/66] 10.222.0.82 () {60 vars in 1285 bytes} [Tue Nov 23 14:25:16 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:25:16.572337 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-f4890288-f5c3-426a-bc86-d99de7cf400e admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:25:16.579817 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-f4890288-f5c3-426a-bc86-d99de7cf400e admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010897 Nov 23 14:25:16.580358 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 33/67] 10.222.0.82 () {60 vars in 1285 bytes} [Tue Nov 23 14:25:16 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:25:16.591784 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-20cec0ee-4c77-4a7a-aaf7-e0bb9cc822fa admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:25:16.599451 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-20cec0ee-4c77-4a7a-aaf7-e0bb9cc822fa admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011029 Nov 23 14:25:16.599954 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 35/68] 10.222.0.82 () {60 vars in 1282 bytes} [Tue Nov 23 14:25:16 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:26:47.126435 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-384b10ab-1928-4e4b-aa70-049c7ad4315b tempest-verify_tempest_config-1945863902 tempest-verify_tempest_config-1945863902-project] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:26:47.128510 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-384b10ab-1928-4e4b-aa70-049c7ad4315b tempest-verify_tempest_config-1945863902 tempest-verify_tempest_config-1945863902-project] 10.222.0.82 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104425 Nov 23 14:26:47.129035 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 34/69] 10.222.0.82 () {58 vars in 1133 bytes} [Tue Nov 23 14:26:47 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:28:19.305440 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-20cec0ee-4c77-4a7a-aaf7-e0bb9cc822fa admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:28:19.307362 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-20cec0ee-4c77-4a7a-aaf7-e0bb9cc822fa admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002331 Nov 23 14:28:19.307762 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 36/70] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Nov 23 14:28:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:28:19.562705 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-30bcf7c9-55b0-40c8-a8d9-9324b31978cb admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:28:19.563871 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:28:19.563871 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: warnings.warn(msg) Nov 23 14:28:19.565446 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-30bcf7c9-55b0-40c8-a8d9-9324b31978cb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:28:19.565891 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-30bcf7c9-55b0-40c8-a8d9-9324b31978cb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:28:19.566689 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-30bcf7c9-55b0-40c8-a8d9-9324b31978cb admin admin] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:28:19.567115 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-30bcf7c9-55b0-40c8-a8d9-9324b31978cb admin admin] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:28:19.601851 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-30bcf7c9-55b0-40c8-a8d9-9324b31978cb admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.150302 Nov 23 14:28:19.602426 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 35/71] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Nov 23 14:28:19 2021] GET /compute/v2.1/os-services => generated 794 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:28:21.070516 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-20cec0ee-4c77-4a7a-aaf7-e0bb9cc822fa admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:28:21.072587 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-20cec0ee-4c77-4a7a-aaf7-e0bb9cc822fa admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Nov 23 14:28:21.072992 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 37/72] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Nov 23 14:28:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:28:21.270245 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-d07373b5-ff5a-4b5b-b0ff-82cc4227bc88 admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:28:21.271425 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:28:21.271425 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: warnings.warn(msg) Nov 23 14:28:21.272982 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-d07373b5-ff5a-4b5b-b0ff-82cc4227bc88 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:28:21.273443 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-d07373b5-ff5a-4b5b-b0ff-82cc4227bc88 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:28:21.274241 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-d07373b5-ff5a-4b5b-b0ff-82cc4227bc88 admin admin] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:28:21.275213 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-d07373b5-ff5a-4b5b-b0ff-82cc4227bc88 admin admin] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:28:21.296123 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-d07373b5-ff5a-4b5b-b0ff-82cc4227bc88 admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078639 Nov 23 14:28:21.296643 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 36/73] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Nov 23 14:28:21 2021] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:28:33.132133 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-20cec0ee-4c77-4a7a-aaf7-e0bb9cc822fa admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:28:33.133160 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-20cec0ee-4c77-4a7a-aaf7-e0bb9cc822fa admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Nov 23 14:28:33.133553 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 38/74] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Nov 23 14:28:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:28:33.328353 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-9ae02040-9a56-4e13-ac94-9442cd05a95a admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:28:33.329512 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:28:33.329512 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: warnings.warn(msg) Nov 23 14:28:33.331019 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-9ae02040-9a56-4e13-ac94-9442cd05a95a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:28:33.331462 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-9ae02040-9a56-4e13-ac94-9442cd05a95a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:28:33.332273 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-9ae02040-9a56-4e13-ac94-9442cd05a95a admin admin] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:28:33.332709 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-9ae02040-9a56-4e13-ac94-9442cd05a95a admin admin] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:28:33.357328 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-9ae02040-9a56-4e13-ac94-9442cd05a95a admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079057 Nov 23 14:28:33.357804 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 37/75] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Nov 23 14:28:33 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:28:34.753648 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: DEBUG nova.api.openstack.wsgi [None req-20cec0ee-4c77-4a7a-aaf7-e0bb9cc822fa admin admin] Calling method '>' {{(pid=102370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:28:34.754671 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: INFO nova.api.openstack.requestlog [None req-20cec0ee-4c77-4a7a-aaf7-e0bb9cc822fa admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Nov 23 14:28:34.755067 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: [pid: 102370|app: 0|req: 39/76] 10.222.0.82 () {56 vars in 1074 bytes} [Tue Nov 23 14:28:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:28:34.949234 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG nova.api.openstack.wsgi [None req-a3ddf324-9636-431b-b693-90cefe6a69a4 admin admin] Calling method '>' {{(pid=102369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:28:34.950416 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:28:34.950416 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: warnings.warn(msg) Nov 23 14:28:34.951955 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-a3ddf324-9636-431b-b693-90cefe6a69a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:28:34.952430 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-a3ddf324-9636-431b-b693-90cefe6a69a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:28:34.953224 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-a3ddf324-9636-431b-b693-90cefe6a69a4 admin admin] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:28:34.953650 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: DEBUG oslo_concurrency.lockutils [None req-a3ddf324-9636-431b-b693-90cefe6a69a4 admin admin] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:28:34.975031 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: INFO nova.api.openstack.requestlog [None req-a3ddf324-9636-431b-b693-90cefe6a69a4 admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.077594 Nov 23 14:28:34.975508 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: [pid: 102369|app: 0|req: 38/77] 10.222.0.82 () {60 vars in 1193 bytes} [Tue Nov 23 14:28:34 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:29:31.546249 dv-cinder-804757-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 23 14:29:31.546774 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: Tue Nov 23 14:29:31 2021 - graceful shutdown triggered... Nov 23 14:29:31.547228 dv-cinder-804757-10-iscsi devstack@n-api.service[102369]: Gracefully killing worker 1 (pid: 102369)... Nov 23 14:29:31.547594 dv-cinder-804757-10-iscsi devstack@n-api.service[102370]: Gracefully killing worker 2 (pid: 102370)... Nov 23 14:29:32.547704 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: worker 1 buried after 1 seconds Nov 23 14:29:32.548156 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: worker 2 buried after 1 seconds Nov 23 14:29:32.548156 dv-cinder-804757-10-iscsi devstack@n-api.service[102368]: goodbye to uWSGI. Nov 23 14:29:32.549334 dv-cinder-804757-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 23 14:29:32.549872 dv-cinder-804757-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 23 14:29:32.552774 dv-cinder-804757-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 23 14:29:32.562879 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 23 14:29:32.564953 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 23 14:29:32 2021] *** Nov 23 14:29:32.564953 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 23 14:29:32.564953 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 23 14:29:32.564953 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: nodename: dv-cinder-804757-10-iscsi Nov 23 14:29:32.564953 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: machine: x86_64 Nov 23 14:29:32.564953 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: clock source: unix Nov 23 14:29:32.564953 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: pcre jit disabled Nov 23 14:29:32.564953 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: detected number of CPU cores: 4 Nov 23 14:29:32.564953 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: current working directory: / Nov 23 14:29:32.564953 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: detected binary path: /usr/bin/uwsgi-core Nov 23 14:29:32.564953 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: your processes number limit is 47680 Nov 23 14:29:32.565666 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: your memory page size is 4096 bytes Nov 23 14:29:32.565666 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: detected max file descriptor number: 2048 Nov 23 14:29:32.565666 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: lock engine: pthread robust mutexes Nov 23 14:29:32.565666 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: thunder lock: enabled Nov 23 14:29:32.565666 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 23 14:29:32.565666 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 23 14:29:32.611475 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: Python main interpreter initialized at 0x557d6b92c9c0 Nov 23 14:29:32.611475 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: python threads support enabled Nov 23 14:29:32.611475 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: your server socket listen backlog is limited to 100 connections Nov 23 14:29:32.611475 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: your mercy for graceful operations on workers is 90 seconds Nov 23 14:29:32.611880 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: mapped 403077 bytes (393 KB) for 2 cores Nov 23 14:29:32.611949 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: *** Operational MODE: preforking *** Nov 23 14:29:32.612213 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: *** uWSGI is running in multiple interpreter mode *** Nov 23 14:29:32.612213 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: spawned uWSGI master process (pid: 116774) Nov 23 14:29:32.612434 dv-cinder-804757-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 23 14:29:32.613568 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: spawned uWSGI worker 1 (pid: 116787, cores: 1) Nov 23 14:29:32.613568 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: spawned uWSGI worker 2 (pid: 116788, cores: 1) Nov 23 14:29:32.613568 dv-cinder-804757-10-iscsi devstack@n-api.service[116774]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 23 14:29:34.382326 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 14:29:34.382326 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: from cryptography.utils import int_from_bytes Nov 23 14:29:34.382992 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 14:29:34.382992 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: from cryptography.utils import int_from_bytes Nov 23 14:29:34.447032 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 14:29:34.447032 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: from cryptography.utils import int_from_bytes Nov 23 14:29:34.447683 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 14:29:34.447683 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: from cryptography.utils import int_from_bytes Nov 23 14:29:36.727461 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 14:29:36.728026 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 14:29:36.728311 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 14:29:36.728605 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 14:29:36.728864 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 14:29:36.729256 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.729590 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.729901 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.730220 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.730553 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.730865 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.731186 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.731501 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.732363 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.732629 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.732952 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.733274 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804757-10-iscsi {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.733601 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.733909 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.734220 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.734541 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.734846 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.735166 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.735470 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.735967 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.737447 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.737447 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.737447 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.737719 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.737955 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.738266 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.738572 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.738873 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.739197 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.739524 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.739911 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804757-10-iscsi {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.740229 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.740561 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.740878 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.741299 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.741617 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.741916 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.742240 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.742573 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.742884 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.743204 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.743517 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.743836 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.744155 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.744485 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.744795 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.745106 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.745426 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.745727 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.746033 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.746285 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.746594 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.746915 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.747310 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.748290 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.748541 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.748800 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.749119 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.749454 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.749760 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.750074 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.750381 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.750691 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.751000 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.751312 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.751621 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.751924 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.752259 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.752581 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.752909 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.753216 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.753535 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.753943 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.754197 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.754507 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.754849 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.755161 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.755476 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.755795 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.756116 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.756452 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.756817 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.757063 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.757383 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.757717 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.758023 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.758275 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.758575 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.758880 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.759201 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.759509 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.759812 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.760117 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.760449 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.760753 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.761058 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.761366 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.761671 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.761977 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.762282 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.762589 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.762918 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.763227 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.763543 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.763861 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.764167 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.764497 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.764802 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.765108 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.765427 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.765732 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.766037 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.766357 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.766662 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.766966 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.767280 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.767585 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.767891 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.768208 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.768534 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.768839 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.769157 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.769670 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.769977 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.770281 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.770589 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.770896 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.771202 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.771505 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.771809 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.772110 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.772464 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.772791 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.773100 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.773410 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.773714 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.774032 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.774371 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.774700 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.775044 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.775357 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.775687 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.776018 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.776361 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.776674 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.776987 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.777312 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.777624 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.777934 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.778246 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.778727 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.779281 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.779616 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.779936 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.780272 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.780602 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.781303 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.781303 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.781531 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.781850 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.782159 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.782684 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.783030 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.783348 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.783676 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.783989 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.784334 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.784818 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.785139 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.785456 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.786318 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.786318 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.786631 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.786780 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.787037 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.787354 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.787660 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.787964 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.788290 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.788605 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.788911 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.789239 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.789568 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.789877 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.790215 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.790521 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.790834 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.791146 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.791449 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.791761 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.792072 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.792406 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.792727 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.793051 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.793341 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.793691 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.793962 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.794828 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.795092 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.795553 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.795868 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.796182 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.796604 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.796920 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.797232 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.797566 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.797900 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.798207 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.798532 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.798857 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.799172 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.799481 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.799852 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.800162 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.800465 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.800712 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.801022 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.801327 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.801628 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.801931 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.802234 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.802563 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.802852 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.803196 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.803459 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.803835 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.804060 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.804427 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.804733 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.805074 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.805411 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.805728 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.806050 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.806363 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.806679 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.806990 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.807301 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.807610 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.807919 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.808250 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.809218 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.809218 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.809218 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.809660 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.810132 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.810533 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.810841 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.811192 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.811539 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.811873 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.812189 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.812558 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.813161 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.813161 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.813574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.813768 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.814062 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.814372 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.814693 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.814999 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.815318 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.815628 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.815949 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.816291 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.816598 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.816902 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.817215 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.817546 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.817882 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.818194 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.818505 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.818825 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.819136 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.819445 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.819763 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.820065 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.820415 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.820711 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.821027 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.821335 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.821645 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.821945 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.822257 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.822641 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.822867 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.823192 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.823503 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.823784 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.824134 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.824437 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.824761 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.825065 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.825959 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.826207 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.826592 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.826818 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.827123 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.827428 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.827629 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 14:29:36.828120 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.828291 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 14:29:36.828528 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.828528 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.828838 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 14:29:36.828979 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.829129 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 14:29:36.829277 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.829432 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 14:29:36.829582 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.829767 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.829920 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.830075 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.830291 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.830531 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.830753 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.830902 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.831062 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.831204 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.831345 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.831500 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.831658 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.831890 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.832155 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.832356 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.832552 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.832731 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.832949 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.833094 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.833269 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.833485 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.833879 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.834042 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804757-10-iscsi {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.834211 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.834448 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.835439 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.835603 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.835756 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.835898 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.836058 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.836308 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.836484 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.836634 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.836784 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.836925 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.836925 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.837199 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.837199 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.837481 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.837639 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.837782 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.837922 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.838153 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.838153 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.838429 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.838429 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.838704 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.838704 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.838999 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.839149 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.839296 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.839436 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.839575 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.839725 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.839875 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.840033 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.840172 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.840336 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.840494 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.840494 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.840919 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804757-10-iscsi {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.841729 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.842143 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.842368 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.842527 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.842669 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.842817 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.842983 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.843248 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.843604 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.843766 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.843935 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.844193 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.844395 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.844664 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.844810 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.844964 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.845105 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.845262 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.845424 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.845565 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.845715 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.845862 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.846003 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.846149 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.846319 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.846582 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.846727 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.847091 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.847242 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.847392 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.847546 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.847687 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.847839 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.847979 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.848116 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.848423 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.848594 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.848747 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.848888 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.849045 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.849144 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.849232 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.849232 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.849381 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.849468 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.849550 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.849632 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.849719 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.849802 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.849882 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.849969 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.850051 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.850140 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.850221 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.850308 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.850398 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.850487 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.850568 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.850843 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.850937 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.851025 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.851107 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.851187 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.851266 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.851355 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.851444 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.851444 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.851607 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.851689 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.851775 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.851868 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.851951 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.852030 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.852137 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.852219 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.852344 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.852430 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.852521 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.852602 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.852690 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.852770 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.852862 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.852945 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.853024 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.853104 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.853209 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.853299 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.853394 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.853475 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.853562 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.853668 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.853750 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.853837 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.853928 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.854016 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.854269 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.854371 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.854586 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.854728 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.854897 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.854996 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.855194 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.855302 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.855500 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.855609 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.855806 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.855907 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.856108 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.856211 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.856465 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.856574 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.856770 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.856885 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.857073 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.857244 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.857428 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.857512 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.857677 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.857772 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.857979 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.858081 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.858282 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.858376 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.858589 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.858697 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.858897 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.858997 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.859207 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.859301 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.859506 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.859606 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.859813 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.859908 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.860119 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.860396 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.860485 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.860556 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.860747 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.860889 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.861054 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.861189 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.861356 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.861497 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.861656 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.861800 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.861957 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.862098 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.862257 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.862408 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.862546 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.862689 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.862862 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.863005 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.863168 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.863307 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.863466 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.863671 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.863804 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.863961 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.864093 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.864230 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.864499 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.864646 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.864786 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.864929 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.865061 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.865189 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.865314 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.865442 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.865606 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.865754 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.865918 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.866061 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.866226 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.866365 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.866535 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.866679 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.866836 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.866975 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.867135 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.867272 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.867448 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.867596 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.867756 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.867888 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.868064 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.868205 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.868434 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.868568 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.868698 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.868828 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.868981 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.869124 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.869289 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.869430 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.869592 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.869725 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.869898 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.870031 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.870200 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.870336 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.870520 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.870656 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.870820 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.870953 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.871128 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.871270 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.871435 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.871575 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.871742 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.871876 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.872048 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.872182 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 14:29:36.872421 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.872673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.872789 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.873167 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.873463 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.873600 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.873819 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.874082 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.874209 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.874333 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.874448 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.874681 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.874802 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.874915 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.875040 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.875215 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.875361 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.875539 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.875687 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.875848 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.876008 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.876198 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.876445 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.876572 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.876693 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.876804 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.876995 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.877127 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.877278 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.877407 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.877604 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.877764 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.877954 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.878086 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.878262 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.878389 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.878586 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.878715 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.878913 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.879040 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.879237 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.879376 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.879547 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.879677 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.879896 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.880043 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.880174 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.880389 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.880600 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.880737 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.880916 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.881164 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.881309 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.881483 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.881632 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.881815 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.881950 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.882112 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.882254 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.882415 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.882564 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.882742 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.882878 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.883047 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.883189 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.883352 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.883606 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.883793 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.883947 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.884101 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.884327 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.884492 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.884683 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.884851 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.884999 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.885142 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.885286 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.885437 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.885604 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.885753 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.885974 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.886133 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.886288 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.886446 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.886597 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.886753 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.886908 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.887070 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.887217 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.887374 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.887527 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.887672 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.887815 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.888510 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.888727 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.888889 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.889255 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.889466 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.889639 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.889786 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.889931 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.890156 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.890306 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.890450 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.890603 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.890755 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.890914 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.891059 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.891202 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.891347 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.891493 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.891649 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.891802 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.891954 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.892098 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.892335 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.892490 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.892635 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.892798 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.892950 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.893109 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.893253 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.893405 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.893550 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.893717 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.893863 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.894008 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.894151 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.894307 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.894467 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.894613 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.894763 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.894907 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.895058 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.895203 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.895361 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.895517 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.895661 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.895816 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.895961 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.896111 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.896284 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.896437 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.896583 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.896727 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.896870 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.897014 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.897170 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.897323 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.897477 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.897631 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.897775 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.897929 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.898088 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.898233 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.898384 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.898534 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.898687 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.898846 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.898991 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.899142 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.899286 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.899483 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.899644 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.899804 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.899956 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.900101 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.900278 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.900430 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.900584 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.900748 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.900902 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.901045 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.901196 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.901341 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.901504 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.901649 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.901793 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.901944 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.902095 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.902250 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.902404 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.902557 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.902708 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.902853 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.903003 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.903162 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.903326 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.903513 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.903725 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.904173 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.904358 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.904505 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.904659 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.904812 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.904964 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.905121 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.905272 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.905272 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.905565 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.905727 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.905872 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.906023 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.906167 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.906320 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.906472 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.906625 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.906777 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.906922 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.907066 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.907219 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.907363 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.907515 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.907669 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.907821 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.907965 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.908119 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.908281 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.908444 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.908624 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.908779 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.908938 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.909094 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.909239 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.909396 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.909556 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.909724 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.909724 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.910019 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.910173 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.910325 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.910476 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.910621 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.910790 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.910946 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.911099 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.911250 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.911394 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.911552 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.911715 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.911867 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.912012 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.912163 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.912367 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.912515 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.912673 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.912826 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.912971 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.913126 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.913271 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.913424 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.913586 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.913731 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.913874 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.914027 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.914172 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.914328 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.914473 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.914624 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.914779 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.914930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.915081 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.915239 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.915393 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.915558 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.915702 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.915846 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.915846 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.916145 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.916318 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.916482 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.916482 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.916858 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.917027 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.917174 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.917317 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.917461 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.917617 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.917770 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.917928 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.918081 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.918232 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.918384 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.918528 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.918681 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.918899 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.919047 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.919784 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.919952 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.920111 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.920320 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.920481 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.920634 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.920778 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.920929 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.921081 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.921240 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.921393 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.921538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.921683 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.921827 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.921970 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.922140 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.922292 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.922443 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.922586 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.922742 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.922895 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.923047 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.923191 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.923343 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.923496 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.923647 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.923809 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.923965 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.924109 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.924337 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.924498 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.924645 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.924802 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.924949 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.925092 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.925236 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.925378 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.925522 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.925674 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.925831 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.925976 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.926120 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.926263 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.926263 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.926547 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.926698 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.926850 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.926850 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.927133 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.927133 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.927420 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.927571 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.927733 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.927884 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.928028 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.928187 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.928356 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.928356 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.928680 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.928842 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.929017 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.929173 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.929317 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.929469 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.929620 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.929782 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.929946 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.930099 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.930243 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.930394 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.930538 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.930690 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.930847 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.930999 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.931152 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.931295 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.931446 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.931600 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.931753 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.931904 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.932056 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.932209 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.932401 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.932558 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.932711 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.932856 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.932998 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.933149 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.933293 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.933293 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.933584 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.933741 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.933893 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.934045 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.934195 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.934350 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.934502 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.934653 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.935429 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.935597 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.935752 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.935912 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.936057 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.936217 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.936398 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.936551 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.936705 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.936849 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.937001 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.937145 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.937288 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.937433 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.937590 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.937735 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.937886 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.938048 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.938201 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.938345 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.938498 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.938654 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.938805 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.938958 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.939110 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.939262 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.939420 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.939565 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.939716 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.939860 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.940033 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.940189 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.940400 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.940556 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.940701 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.940862 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.941014 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.941168 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.941320 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.941472 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.941617 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.941775 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.941927 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.942121 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.942287 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.942451 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.942596 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.942739 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.942891 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.942891 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.943180 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.943334 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.943491 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.943644 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.943802 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.943959 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.944121 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.944299 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.944459 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.944605 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.944763 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.944915 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.945069 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.945214 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.945364 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.945508 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.945652 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.945813 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.945979 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.946125 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.946276 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.946421 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.946421 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.946710 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.946866 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.947024 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.947174 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.947325 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.947477 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.947620 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.947772 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.947928 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.948079 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.948223 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.948431 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.948591 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.948591 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.948866 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.949023 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.949023 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.949296 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.949453 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.949597 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.949742 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.949896 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.950059 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.950210 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.950869 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.951026 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.951190 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.951338 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.951664 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.951814 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.951967 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.952114 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.952288 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.952468 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.952634 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.952789 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.952934 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.953077 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.953230 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.953393 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.953550 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.953712 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.953858 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.954001 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.954156 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.954304 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.954468 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.954623 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.954768 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.954911 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.955063 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.955207 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.955362 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.955507 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.955657 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.955811 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.955963 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.956108 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.956304 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.956467 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.956637 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.956795 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.956940 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.957085 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.957254 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.957412 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.957557 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.957701 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.957853 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.957997 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.958166 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.958330 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.958491 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.958635 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.958793 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.958952 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.959106 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.959249 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.959392 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.959536 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.959688 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.959840 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.959993 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.960155 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.960336 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.960486 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.960641 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.960798 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.960954 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.961103 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.961247 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.961397 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.961568 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.961724 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.961869 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.962013 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.962236 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.962417 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.962573 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.962726 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.962886 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.963031 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.963175 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.963327 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.963517 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.963690 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.963839 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.963983 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.964141 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.964357 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.964522 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.964669 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.964814 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.964964 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.965108 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.965281 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.965435 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.965579 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.965730 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.965880 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.966585 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.966918 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.967079 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.967231 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.967376 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.967518 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.967662 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.967815 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.967966 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.968110 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.968280 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.968431 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.968577 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.968732 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.968878 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.969039 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.969184 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.969335 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.969547 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.969694 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.969917 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.970078 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.970230 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.970377 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.970535 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.970680 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.970831 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.970993 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.971139 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.971289 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.971447 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.971592 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.971735 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.971887 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.972032 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.972190 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.972457 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.972621 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.972773 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.972931 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.973095 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.973260 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.973419 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.973576 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.973728 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.973885 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.974043 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.974204 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.974355 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.974570 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.974787 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.974941 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.975117 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.975272 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.975443 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.975595 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.975752 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.975911 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.976072 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.976225 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.976404 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.976555 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.976718 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.976877 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.977043 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.977215 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.977368 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.977526 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.977678 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.977836 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.978002 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.978166 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.978319 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.978470 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.978621 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.978780 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.978940 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.979092 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.979092 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 14:29:36.979392 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.979392 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.979392 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.979837 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.979837 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.980139 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.980458 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.980768 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.981193 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.981514 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.981885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.982207 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.982518 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.982827 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.983145 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.983474 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.983789 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.984096 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.984452 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.984782 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.985092 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.985421 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.985847 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.986164 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.986476 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.986899 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.987252 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.987572 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.987902 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.988382 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.989384 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.989707 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.990032 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.990359 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.990694 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.991027 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.991348 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.992339 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.992339 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.992787 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.992787 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.993110 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.993412 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.993837 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.994170 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.994490 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.994818 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.995154 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.995470 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.995784 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.996992 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.996992 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.996992 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.997515 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.997812 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.998217 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.998546 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.998868 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.999185 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.999500 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:36.999836 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.000149 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.000529 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.000878 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.001214 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.001541 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.001852 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.002183 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.002501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.002809 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.003124 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.003292 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_db.sqlalchemy.engines [None req-bd3f9bbf-e569-49ab-8606-8beed479c0a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 14:29:37.003600 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.003762 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.004073 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.004428 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.004770 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.005113 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.005429 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.005771 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.006104 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.006432 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.006754 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.007082 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.007396 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.007724 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.008019 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.008359 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.008672 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.008980 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.009293 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.009599 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.009906 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.010213 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.010545 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.010853 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.011179 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.011493 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.011801 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.012112 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.012442 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.012795 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.013713 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.013958 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.014293 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.014620 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.014956 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.015270 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.015601 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.015923 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.016260 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.016586 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.016908 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.017230 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.017552 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.017874 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.018192 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.018548 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.018877 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.019200 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.019972 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.020152 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.021344 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.021693 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.022017 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.022343 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.022786 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.022987 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.023308 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.023909 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.023909 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.028309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.028309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.028309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.028309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.028309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.028309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.028309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.028309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.029673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.029673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.029673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.029673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.029673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.029673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.029673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.030109 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.030827 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.030827 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.030992 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.031381 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.031600 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.031886 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.032224 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.032598 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.032930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.033254 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.033582 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.033905 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.034490 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.034816 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.035163 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.035500 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.035835 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.036163 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.036522 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.036859 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.037173 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.037486 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.037802 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.038120 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.038432 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.038761 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.039081 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.039392 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.039716 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.040031 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.040659 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.041017 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.041342 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.041676 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.042007 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.042330 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.042641 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.042972 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.043286 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.043592 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.043917 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.044337 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.044686 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.045194 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.045497 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.045825 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.046125 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.046449 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.046759 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.047094 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.047404 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.047714 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.048024 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.048369 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.048684 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.048994 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.049307 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.049616 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.049937 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.050246 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.050567 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.050877 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.051194 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.051503 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.051821 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.052134 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.052498 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.052813 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.053123 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.053453 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.053769 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.054101 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.054422 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.054739 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.055099 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.055424 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.056030 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.056466 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.056804 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.057157 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.057497 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.057816 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.058128 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.058442 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.058775 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.059093 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.059412 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.059762 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.060081 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.060448 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.060853 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.061197 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.061516 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.061835 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.062165 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.062525 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.062854 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.063178 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.063557 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.063820 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.064200 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.064544 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.064863 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.065180 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.065507 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.065849 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.066249 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.066552 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.066924 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.067230 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.067557 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.067998 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.068204 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.068571 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.068903 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.069223 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.069551 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.069870 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.070207 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.070563 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.070901 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.071235 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.071547 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.071859 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.072170 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.072512 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.072849 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.073192 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.073515 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.073846 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.074162 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.074491 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.074806 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.075133 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.076072 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.076689 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.077059 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.077331 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.077587 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.077908 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.078225 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.078538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.078853 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.079169 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.079506 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.079835 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.080147 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.080529 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.080855 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.081187 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.081510 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.081826 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.082162 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.082650 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.082825 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.083109 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.083422 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.083793 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.084105 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.084536 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.084875 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.085211 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.085545 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.085906 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.086229 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.086682 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.086977 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.087225 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.087547 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.087856 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 14:29:37.088106 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 14:29:37.111676 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_db.sqlalchemy.engines [None req-bdd30a88-fe4f-44d8-90d7-4c492b66e1d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 14:29:37.161943 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.context [None req-bd3f9bbf-e569-49ab-8606-8beed479c0a1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0b6352a7-9cca-435b-bdd7-4cf12ee239c0(cell1) {{(pid=116788) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 14:29:37.166585 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bd3f9bbf-e569-49ab-8606-8beed479c0a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:29:37.168307 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bd3f9bbf-e569-49ab-8606-8beed479c0a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:29:37.169254 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bd3f9bbf-e569-49ab-8606-8beed479c0a1 None None] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:29:37.171287 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bd3f9bbf-e569-49ab-8606-8beed479c0a1 None None] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:29:37.182482 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_db.sqlalchemy.engines [None req-bd3f9bbf-e569-49ab-8606-8beed479c0a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 14:29:37.186715 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_db.sqlalchemy.engines [None req-bd3f9bbf-e569-49ab-8606-8beed479c0a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 14:29:37.269565 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.context [None req-bdd30a88-fe4f-44d8-90d7-4c492b66e1d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0b6352a7-9cca-435b-bdd7-4cf12ee239c0(cell1) {{(pid=116787) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 14:29:37.274000 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bdd30a88-fe4f-44d8-90d7-4c492b66e1d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:29:37.275595 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bdd30a88-fe4f-44d8-90d7-4c492b66e1d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:29:37.276501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bdd30a88-fe4f-44d8-90d7-4c492b66e1d0 None None] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:29:37.278671 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bdd30a88-fe4f-44d8-90d7-4c492b66e1d0 None None] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:29:37.290067 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_db.sqlalchemy.engines [None req-bdd30a88-fe4f-44d8-90d7-4c492b66e1d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 14:29:37.291400 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_db.sqlalchemy.engines [None req-bdd30a88-fe4f-44d8-90d7-4c492b66e1d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 14:29:37.356668 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_db.sqlalchemy.engines [None req-bd3f9bbf-e569-49ab-8606-8beed479c0a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 14:29:37.453485 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_db.sqlalchemy.engines [None req-bdd30a88-fe4f-44d8-90d7-4c492b66e1d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 14:29:37.680347 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: WARNING keystonemiddleware.auth_token [None req-bd3f9bbf-e569-49ab-8606-8beed479c0a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 14:29:37.686896 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: WARNING keystonemiddleware.auth_token [None req-bd3f9bbf-e569-49ab-8606-8beed479c0a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 14:29:37.774735 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: WARNING keystonemiddleware.auth_token [None req-bdd30a88-fe4f-44d8-90d7-4c492b66e1d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 14:29:37.782078 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: WARNING keystonemiddleware.auth_token [None req-bdd30a88-fe4f-44d8-90d7-4c492b66e1d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 14:29:38.034669 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: WARNING keystonemiddleware.auth_token [None req-bd3f9bbf-e569-49ab-8606-8beed479c0a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 14:29:38.040214 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: WARNING keystonemiddleware.auth_token [None req-bd3f9bbf-e569-49ab-8606-8beed479c0a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 14:29:38.046518 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557d6b92c9c0 pid: 116788 (default app) Nov 23 14:29:38.123174 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: WARNING keystonemiddleware.auth_token [None req-bdd30a88-fe4f-44d8-90d7-4c492b66e1d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 14:29:38.128380 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: WARNING keystonemiddleware.auth_token [None req-bdd30a88-fe4f-44d8-90d7-4c492b66e1d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 14:29:38.133688 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557d6b92c9c0 pid: 116787 (default app) Nov 23 14:30:12.981663 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-89f59cda-6e9f-491c-ba76-c7b0a7025963 tempest-VolumesGetTestJSON-38632212 tempest-VolumesGetTestJSON-38632212-project] Action: 'create', calling method: .version_select at 0x7f2088eee280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1144634960", "metadata": {"Type": "work"}}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:30:15.011187 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-89f59cda-6e9f-491c-ba76-c7b0a7025963 tempest-VolumesGetTestJSON-38632212 tempest-VolumesGetTestJSON-38632212-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.395512 Nov 23 14:30:15.011889 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 1/1] 10.222.0.82 () {60 vars in 1155 bytes} [Tue Nov 23 14:30:11 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 3398 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 23 14:30:15.027047 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a5caa428-69b2-4fbd-b415-302f8c689b1e tempest-VolumesGetTestJSON-38632212 tempest-VolumesGetTestJSON-38632212-project] Calling method '.version_select at 0x7f2088db6e50>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:15.404638 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a5caa428-69b2-4fbd-b415-302f8c689b1e tempest-VolumesGetTestJSON-38632212 tempest-VolumesGetTestJSON-38632212-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/1b4406ef-3d63-43c6-aa8b-f89e717e0197" status: 200 len: 353 microversion: 2.1 time: 0.382596 Nov 23 14:30:15.406621 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 2/2] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Nov 23 14:30:15 2021] GET /compute/v2.1/os-volumes/1b4406ef-3d63-43c6-aa8b-f89e717e0197 => generated 353 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:30:15.622097 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6c9d4b83-fe12-45a9-9c32-0d8cbf0a897d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1058385951", "imageRef": "b06b9241-c147-436d-86bb-7c49ad8ef09c", "flavorRef": "452", "networks": [{"uuid": "80e9ea19-d253-45d4-b23b-95319665cd2f"}]}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:30:16.419034 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-94901844-fce1-41b5-8d05-57ba796519b7 tempest-VolumesGetTestJSON-38632212 tempest-VolumesGetTestJSON-38632212-project] Calling method '.version_select at 0x7f2088eeeaf0>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:16.553652 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-94901844-fce1-41b5-8d05-57ba796519b7 tempest-VolumesGetTestJSON-38632212 tempest-VolumesGetTestJSON-38632212-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/1b4406ef-3d63-43c6-aa8b-f89e717e0197" status: 200 len: 354 microversion: 2.1 time: 0.139153 Nov 23 14:30:16.563469 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 3/3] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Nov 23 14:30:16 2021] GET /compute/v2.1/os-volumes/1b4406ef-3d63-43c6-aa8b-f89e717e0197 => generated 354 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:30:16.568805 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-491d20bf-3f77-4898-a33f-714a1659621c tempest-VolumesGetTestJSON-38632212 tempest-VolumesGetTestJSON-38632212-project] Calling method '.version_select at 0x7f2088d4b790>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:16.609802 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.network.neutron [None req-6c9d4b83-fe12-45a9-9c32-0d8cbf0a897d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] validate_networks() for [('80e9ea19-d253-45d4-b23b-95319665cd2f', None, None, None, None, None)] {{(pid=116787) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:30:16.697021 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-491d20bf-3f77-4898-a33f-714a1659621c tempest-VolumesGetTestJSON-38632212 tempest-VolumesGetTestJSON-38632212-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/1b4406ef-3d63-43c6-aa8b-f89e717e0197" status: 200 len: 354 microversion: 2.1 time: 0.132000 Nov 23 14:30:16.698296 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 4/4] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Nov 23 14:30:16 2021] GET /compute/v2.1/os-volumes/1b4406ef-3d63-43c6-aa8b-f89e717e0197 => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:30:16.735928 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d0aa808e-33bb-41e1-a998-9f1d54024c03 tempest-VolumesGetTestJSON-38632212 tempest-VolumesGetTestJSON-38632212-project] Calling method '.version_select at 0x7f2088d500d0>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:17.115733 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d0aa808e-33bb-41e1-a998-9f1d54024c03 tempest-VolumesGetTestJSON-38632212 tempest-VolumesGetTestJSON-38632212-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/1b4406ef-3d63-43c6-aa8b-f89e717e0197" status: 202 len: 0 microversion: 2.1 time: 0.391116 Nov 23 14:30:17.119374 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 5/5] 10.222.0.82 () {58 vars in 1247 bytes} [Tue Nov 23 14:30:16 2021] DELETE /compute/v2.1/os-volumes/1b4406ef-3d63-43c6-aa8b-f89e717e0197 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:30:17.125942 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-681b493c-2b26-4267-9b1b-12809b410c25 tempest-VolumesGetTestJSON-38632212 tempest-VolumesGetTestJSON-38632212-project] Calling method '.version_select at 0x7f2088db6f70>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:17.303068 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-681b493c-2b26-4267-9b1b-12809b410c25 tempest-VolumesGetTestJSON-38632212 tempest-VolumesGetTestJSON-38632212-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/1b4406ef-3d63-43c6-aa8b-f89e717e0197" status: 200 len: 353 microversion: 2.1 time: 0.182345 Nov 23 14:30:17.308602 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 6/6] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Nov 23 14:30:17 2021] GET /compute/v2.1/os-volumes/1b4406ef-3d63-43c6-aa8b-f89e717e0197 => generated 353 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:30:18.280000 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-6c9d4b83-fe12-45a9-9c32-0d8cbf0a897d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Flavor limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:30:18.281530 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-6c9d4b83-fe12-45a9-9c32-0d8cbf0a897d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Image limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:30:18.282259 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-6c9d4b83-fe12-45a9-9c32-0d8cbf0a897d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Flavor pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:30:18.282874 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-6c9d4b83-fe12-45a9-9c32-0d8cbf0a897d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Image pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:30:18.283503 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-6c9d4b83-fe12-45a9-9c32-0d8cbf0a897d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:30:18.299339 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c9d4b83-fe12-45a9-9c32-0d8cbf0a897d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:18.304538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c9d4b83-fe12-45a9-9c32-0d8cbf0a897d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:18.304538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c9d4b83-fe12-45a9-9c32-0d8cbf0a897d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:18.304538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c9d4b83-fe12-45a9-9c32-0d8cbf0a897d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:18.319899 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-22e2155d-c760-49fe-9e28-e9d931fb823f tempest-VolumesGetTestJSON-38632212 tempest-VolumesGetTestJSON-38632212-project] Calling method '.version_select at 0x7f2088d50160>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:18.389338 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-22e2155d-c760-49fe-9e28-e9d931fb823f tempest-VolumesGetTestJSON-38632212 tempest-VolumesGetTestJSON-38632212-project] HTTP exception thrown: Volume 1b4406ef-3d63-43c6-aa8b-f89e717e0197 could not be found. Nov 23 14:30:18.390375 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-22e2155d-c760-49fe-9e28-e9d931fb823f tempest-VolumesGetTestJSON-38632212 tempest-VolumesGetTestJSON-38632212-project] Returning 404 to user: Volume 1b4406ef-3d63-43c6-aa8b-f89e717e0197 could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:30:18.391597 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-22e2155d-c760-49fe-9e28-e9d931fb823f tempest-VolumesGetTestJSON-38632212 tempest-VolumesGetTestJSON-38632212-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/1b4406ef-3d63-43c6-aa8b-f89e717e0197" status: 404 len: 109 microversion: 2.1 time: 0.078939 Nov 23 14:30:18.393013 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 7/7] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Nov 23 14:30:18 2021] GET /compute/v2.1/os-volumes/1b4406ef-3d63-43c6-aa8b-f89e717e0197 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:30:18.426133 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-6c9d4b83-fe12-45a9-9c32-0d8cbf0a897d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Getting quotas for project bc6dcdf0bd0d4ba4b54402a4c1cc6023. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:30:18.437569 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-6c9d4b83-fe12-45a9-9c32-0d8cbf0a897d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Getting quotas for user 55f4c018a8804e2ab109fede8fccc62a and project bc6dcdf0bd0d4ba4b54402a4c1cc6023. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:30:18.455929 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6c9d4b83-fe12-45a9-9c32-0d8cbf0a897d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Going to run 1 instances... {{(pid=116787) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:30:18.461256 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6c9d4b83-fe12-45a9-9c32-0d8cbf0a897d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b06b9241-c147-436d-86bb-7c49ad8ef09c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:30:18.696510 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6c9d4b83-fe12-45a9-9c32-0d8cbf0a897d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.767150 Nov 23 14:30:18.697710 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 1/8] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:30:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 3770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 14:30:18.708683 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-75dd5476-d9e9-484d-8f53-b60bbe8b3a84 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:18.709444 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-75dd5476-d9e9-484d-8f53-b60bbe8b3a84 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:19.045773 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-75dd5476-d9e9-484d-8f53-b60bbe8b3a84 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:19.068270 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-75dd5476-d9e9-484d-8f53-b60bbe8b3a84 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1215 microversion: 2.1 time: 0.363319 Nov 23 14:30:19.080894 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 8/9] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:18 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1215 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:20.104024 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5aebb2de-e68a-482f-b17c-9e3c6b34161d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:20.104024 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5aebb2de-e68a-482f-b17c-9e3c6b34161d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:20.405861 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5aebb2de-e68a-482f-b17c-9e3c6b34161d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:20.451082 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5aebb2de-e68a-482f-b17c-9e3c6b34161d tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1215 microversion: 2.1 time: 0.367982 Nov 23 14:30:20.457229 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 2/10] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:20 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1215 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:21.476355 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6497b32e-1589-4636-937b-1f8279ee72d6 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:21.477802 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6497b32e-1589-4636-937b-1f8279ee72d6 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:21.891728 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6497b32e-1589-4636-937b-1f8279ee72d6 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:21.891728 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6497b32e-1589-4636-937b-1f8279ee72d6 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1215 microversion: 2.1 time: 0.351441 Nov 23 14:30:21.891728 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 9/11] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:21 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1215 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:22.839984 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-db269430-fa55-47dd-93ad-6649b04602d2 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:22.840924 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-db269430-fa55-47dd-93ad-6649b04602d2 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:22.862618 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-db269430-fa55-47dd-93ad-6649b04602d2 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:22.864653 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-db269430-fa55-47dd-93ad-6649b04602d2 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:22.865649 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-db269430-fa55-47dd-93ad-6649b04602d2 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:22.868010 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-db269430-fa55-47dd-93ad-6649b04602d2 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:23.295910 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-db269430-fa55-47dd-93ad-6649b04602d2 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:23.309001 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-db269430-fa55-47dd-93ad-6649b04602d2 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1219 microversion: 2.1 time: 0.472630 Nov 23 14:30:23.309735 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 3/12] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:22 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1219 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:24.326898 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-94644117-9fea-4feb-8e1b-93414755b722 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:24.328220 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-94644117-9fea-4feb-8e1b-93414755b722 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:24.345231 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-94644117-9fea-4feb-8e1b-93414755b722 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:24.349338 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-94644117-9fea-4feb-8e1b-93414755b722 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:24.350349 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-94644117-9fea-4feb-8e1b-93414755b722 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:24.351112 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-94644117-9fea-4feb-8e1b-93414755b722 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:24.703717 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-94644117-9fea-4feb-8e1b-93414755b722 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:24.778640 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-94644117-9fea-4feb-8e1b-93414755b722 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1219 microversion: 2.1 time: 0.456013 Nov 23 14:30:24.792473 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 10/13] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:24 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1219 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:25.808712 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-dcbc5ea2-3908-450b-a53e-b16c8cc09d8c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:25.809313 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-dcbc5ea2-3908-450b-a53e-b16c8cc09d8c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:25.821835 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dcbc5ea2-3908-450b-a53e-b16c8cc09d8c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:25.825531 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dcbc5ea2-3908-450b-a53e-b16c8cc09d8c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:25.829396 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dcbc5ea2-3908-450b-a53e-b16c8cc09d8c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:25.832784 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dcbc5ea2-3908-450b-a53e-b16c8cc09d8c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:25.989724 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-dcbc5ea2-3908-450b-a53e-b16c8cc09d8c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:25.997938 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-dcbc5ea2-3908-450b-a53e-b16c8cc09d8c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1211 microversion: 2.1 time: 0.192747 Nov 23 14:30:26.003363 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 4/14] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:25 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1211 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:27.025341 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-bfacfe92-5895-4ff0-9f47-513879eb44ad tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:27.029162 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-bfacfe92-5895-4ff0-9f47-513879eb44ad tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:27.051242 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bfacfe92-5895-4ff0-9f47-513879eb44ad tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:27.051881 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bfacfe92-5895-4ff0-9f47-513879eb44ad tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:27.052902 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bfacfe92-5895-4ff0-9f47-513879eb44ad tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:27.053649 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bfacfe92-5895-4ff0-9f47-513879eb44ad tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:27.205410 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-40856aed-43a3-478a-b347-b6411802f6ff tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-152522977", "imageRef": "b06b9241-c147-436d-86bb-7c49ad8ef09c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c8a5eb1-a1ef-474e-b6f5-6b6329e1afd1"}]}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:30:27.310068 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-bfacfe92-5895-4ff0-9f47-513879eb44ad tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:27.327009 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-bfacfe92-5895-4ff0-9f47-513879eb44ad tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1275 microversion: 2.1 time: 0.304939 Nov 23 14:30:27.328559 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 5/15] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:27 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1275 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:27.489618 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.network.neutron [None req-40856aed-43a3-478a-b347-b6411802f6ff tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] validate_networks() for [('2c8a5eb1-a1ef-474e-b6f5-6b6329e1afd1', None, None, None, None, None)] {{(pid=116788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:30:28.343264 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7a5aad20-87a2-4a0e-9c57-dfaf0df2f742 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:28.344415 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7a5aad20-87a2-4a0e-9c57-dfaf0df2f742 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:28.355299 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a5aad20-87a2-4a0e-9c57-dfaf0df2f742 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:28.356768 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a5aad20-87a2-4a0e-9c57-dfaf0df2f742 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:28.360747 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a5aad20-87a2-4a0e-9c57-dfaf0df2f742 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:28.361424 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a5aad20-87a2-4a0e-9c57-dfaf0df2f742 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:28.662445 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7a5aad20-87a2-4a0e-9c57-dfaf0df2f742 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:28.681035 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7a5aad20-87a2-4a0e-9c57-dfaf0df2f742 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1273 microversion: 2.1 time: 0.341312 Nov 23 14:30:28.683996 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 6/16] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:28 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1273 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:30:29.715831 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e6247ed0-ae65-4269-8d68-932489ea8cd4 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:29.719708 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e6247ed0-ae65-4269-8d68-932489ea8cd4 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:29.744443 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e6247ed0-ae65-4269-8d68-932489ea8cd4 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:29.746098 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e6247ed0-ae65-4269-8d68-932489ea8cd4 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:29.747176 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e6247ed0-ae65-4269-8d68-932489ea8cd4 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:29.747846 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e6247ed0-ae65-4269-8d68-932489ea8cd4 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:30.154046 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-40856aed-43a3-478a-b347-b6411802f6ff tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Flavor limits 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:30:30.154046 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-40856aed-43a3-478a-b347-b6411802f6ff tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Image limits 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:30:30.154046 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-40856aed-43a3-478a-b347-b6411802f6ff tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Flavor pref 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:30:30.154046 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-40856aed-43a3-478a-b347-b6411802f6ff tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Image pref 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:30:30.154046 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-40856aed-43a3-478a-b347-b6411802f6ff tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:30:30.197933 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-40856aed-43a3-478a-b347-b6411802f6ff tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:30.198372 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-40856aed-43a3-478a-b347-b6411802f6ff tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:30.199175 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-40856aed-43a3-478a-b347-b6411802f6ff tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:30.199603 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-40856aed-43a3-478a-b347-b6411802f6ff tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:30.291831 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-40856aed-43a3-478a-b347-b6411802f6ff tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Getting quotas for project 39cee3fc64784108bc54007c1c6c0ca6. Resources: {'instances', 'cores', 'ram'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:30:30.308724 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-40856aed-43a3-478a-b347-b6411802f6ff tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Getting quotas for user b65c7b8ae9694a34823d2e45482ea928 and project 39cee3fc64784108bc54007c1c6c0ca6. Resources: {'instances', 'cores', 'ram'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:30:30.324638 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e6247ed0-ae65-4269-8d68-932489ea8cd4 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:30.328729 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e6247ed0-ae65-4269-8d68-932489ea8cd4 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.631487 Nov 23 14:30:30.355852 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 7/17] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:29 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:30.375272 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-40856aed-43a3-478a-b347-b6411802f6ff tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Going to run 1 instances... {{(pid=116788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:30:30.393302 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-40856aed-43a3-478a-b347-b6411802f6ff tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b06b9241-c147-436d-86bb-7c49ad8ef09c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:30:30.668902 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-40856aed-43a3-478a-b347-b6411802f6ff tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.879198 Nov 23 14:30:30.670152 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 11/18] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:30:26 2021] POST /compute/v2.1/servers => generated 383 bytes in 3887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 14:30:30.689374 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6872516c-ee36-4b4c-ace6-aaec397670f6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:30.703789 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6872516c-ee36-4b4c-ace6-aaec397670f6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:31.160501 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6872516c-ee36-4b4c-ace6-aaec397670f6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:31.172954 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6872516c-ee36-4b4c-ace6-aaec397670f6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1221 microversion: 2.1 time: 0.496394 Nov 23 14:30:31.188796 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 12/19] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:30 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1221 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:31.346950 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-963ea900-7f23-498a-9f73-3bf97925f354 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:31.347911 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-963ea900-7f23-498a-9f73-3bf97925f354 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:31.363195 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-963ea900-7f23-498a-9f73-3bf97925f354 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:31.371320 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-963ea900-7f23-498a-9f73-3bf97925f354 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:31.377029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-963ea900-7f23-498a-9f73-3bf97925f354 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:31.378118 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-963ea900-7f23-498a-9f73-3bf97925f354 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:31.828054 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-963ea900-7f23-498a-9f73-3bf97925f354 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:31.854290 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3d5600b2-b8f2-4942-9d4b-90213fa1865c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'create', calling method: .version_select at 0x7f2089714940>, body: {"keypair": {"name": "tempest-keypair-907714560"}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:30:31.863638 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-963ea900-7f23-498a-9f73-3bf97925f354 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.519973 Nov 23 14:30:31.864490 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 13/20] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:31 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:30:31.960020 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-3d5600b2-b8f2-4942-9d4b-90213fa1865c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Getting quotas for project 45e139a46b8d40e4a8a321403730eb71. Resources: {'key_pairs'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:30:31.971748 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-3d5600b2-b8f2-4942-9d4b-90213fa1865c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Getting quotas for user 641f2f7ca87d4245a59f2dbe7b98759a and project 45e139a46b8d40e4a8a321403730eb71. Resources: {'key_pairs'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:30:32.186808 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-0d004043-7d8c-4b63-ad71-11fa0325a45f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'create', calling method: .version_select at 0x7f2088350160>, body: {"keypair": {"name": "tempest-keypair-1765117141"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:30:32.239804 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-0d004043-7d8c-4b63-ad71-11fa0325a45f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Getting quotas for project 6cd08103499348da976aa1b8d926a748. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:30:32.252747 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-0d004043-7d8c-4b63-ad71-11fa0325a45f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Getting quotas for user 65b0720c8f9b47888a5e315c01ac65bb and project 6cd08103499348da976aa1b8d926a748. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:30:32.594270 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-3d5600b2-b8f2-4942-9d4b-90213fa1865c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Getting quotas for project 45e139a46b8d40e4a8a321403730eb71. Resources: {'key_pairs'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:30:32.615093 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-3d5600b2-b8f2-4942-9d4b-90213fa1865c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Getting quotas for user 641f2f7ca87d4245a59f2dbe7b98759a and project 45e139a46b8d40e4a8a321403730eb71. Resources: {'key_pairs'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:30:32.687819 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3d5600b2-b8f2-4942-9d4b-90213fa1865c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 2.111971 Nov 23 14:30:32.688638 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 8/21] 10.222.0.82 () {62 vars in 1198 bytes} [Tue Nov 23 14:30:30 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 2114 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 23 14:30:32.702536 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ebe98720-cc38-4740-837f-7e466044d719 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-946545001", "imageRef": "b06b9241-c147-436d-86bb-7c49ad8ef09c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c8a5eb1-a1ef-474e-b6f5-6b6329e1afd1"}]}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:30:32.861282 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.network.neutron [None req-ebe98720-cc38-4740-837f-7e466044d719 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] validate_networks() for [('2c8a5eb1-a1ef-474e-b6f5-6b6329e1afd1', None, None, None, None, None)] {{(pid=116787) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:30:33.356609 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-0d004043-7d8c-4b63-ad71-11fa0325a45f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Getting quotas for project 6cd08103499348da976aa1b8d926a748. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:30:33.366910 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-0d004043-7d8c-4b63-ad71-11fa0325a45f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Getting quotas for user 65b0720c8f9b47888a5e315c01ac65bb and project 6cd08103499348da976aa1b8d926a748. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:30:33.425933 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-0d004043-7d8c-4b63-ad71-11fa0325a45f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.555073 Nov 23 14:30:33.430575 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 14/22] 10.222.0.82 () {60 vars in 1157 bytes} [Tue Nov 23 14:30:31 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:33.450626 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-719e353d-b265-4562-a1eb-f194503f538b tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:33.452493 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-719e353d-b265-4562-a1eb-f194503f538b tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:33.469295 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-719e353d-b265-4562-a1eb-f194503f538b tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:33.473916 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-719e353d-b265-4562-a1eb-f194503f538b tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:33.473916 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-719e353d-b265-4562-a1eb-f194503f538b tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:33.473916 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-719e353d-b265-4562-a1eb-f194503f538b tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:34.038141 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-719e353d-b265-4562-a1eb-f194503f538b tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:34.065290 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-719e353d-b265-4562-a1eb-f194503f538b tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.633544 Nov 23 14:30:34.072758 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 15/23] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:33 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:34.138758 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-ebe98720-cc38-4740-837f-7e466044d719 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Flavor limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:30:34.140397 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-ebe98720-cc38-4740-837f-7e466044d719 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Image limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:30:34.141054 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-ebe98720-cc38-4740-837f-7e466044d719 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Flavor pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:30:34.141652 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-ebe98720-cc38-4740-837f-7e466044d719 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Image pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:30:34.142245 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-ebe98720-cc38-4740-837f-7e466044d719 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:30:34.163544 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ebe98720-cc38-4740-837f-7e466044d719 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:34.165338 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ebe98720-cc38-4740-837f-7e466044d719 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:34.166486 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ebe98720-cc38-4740-837f-7e466044d719 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:34.167181 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ebe98720-cc38-4740-837f-7e466044d719 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:34.249604 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-ebe98720-cc38-4740-837f-7e466044d719 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Getting quotas for project 39cee3fc64784108bc54007c1c6c0ca6. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:30:34.269668 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-ebe98720-cc38-4740-837f-7e466044d719 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Getting quotas for user b65c7b8ae9694a34823d2e45482ea928 and project 39cee3fc64784108bc54007c1c6c0ca6. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:30:34.299915 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ebe98720-cc38-4740-837f-7e466044d719 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Going to run 1 instances... {{(pid=116787) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:30:34.302624 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ebe98720-cc38-4740-837f-7e466044d719 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b06b9241-c147-436d-86bb-7c49ad8ef09c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:30:34.538738 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ebe98720-cc38-4740-837f-7e466044d719 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.847548 Nov 23 14:30:34.546867 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 9/24] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:30:32 2021] POST /compute/v2.1/servers => generated 383 bytes in 1858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 14:30:34.559438 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-47c16e9e-0135-4f56-abf5-ffc58664f61a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:34.562907 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-47c16e9e-0135-4f56-abf5-ffc58664f61a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:34.746924 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-47c16e9e-0135-4f56-abf5-ffc58664f61a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:34.757192 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-47c16e9e-0135-4f56-abf5-ffc58664f61a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1221 microversion: 2.1 time: 0.205926 Nov 23 14:30:34.758852 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 16/25] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:34 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1221 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:35.101188 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-389c5c2c-7479-4565-a4c1-34f418a857a5 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:35.101188 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-389c5c2c-7479-4565-a4c1-34f418a857a5 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:35.115262 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-389c5c2c-7479-4565-a4c1-34f418a857a5 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:35.115721 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-389c5c2c-7479-4565-a4c1-34f418a857a5 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:35.134815 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-389c5c2c-7479-4565-a4c1-34f418a857a5 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:35.139859 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-389c5c2c-7479-4565-a4c1-34f418a857a5 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:35.766540 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-389c5c2c-7479-4565-a4c1-34f418a857a5 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:35.775028 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e61dc480-6a74-4d99-afd2-7ca8214131bf tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:35.775782 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e61dc480-6a74-4d99-afd2-7ca8214131bf tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:35.775899 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-389c5c2c-7479-4565-a4c1-34f418a857a5 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.689737 Nov 23 14:30:35.793699 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 10/26] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:35 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:35.976158 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e61dc480-6a74-4d99-afd2-7ca8214131bf tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:36.011913 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e61dc480-6a74-4d99-afd2-7ca8214131bf tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1221 microversion: 2.1 time: 0.238693 Nov 23 14:30:36.013696 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 17/27] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:35 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1221 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:36.812597 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5345f051-7fce-41ef-b408-11949c67fd19 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:36.813307 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5345f051-7fce-41ef-b408-11949c67fd19 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:36.826602 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5345f051-7fce-41ef-b408-11949c67fd19 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:36.827248 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5345f051-7fce-41ef-b408-11949c67fd19 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:36.829521 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5345f051-7fce-41ef-b408-11949c67fd19 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:36.842563 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5345f051-7fce-41ef-b408-11949c67fd19 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:37.029320 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-4c6065b3-2a9d-46f3-bddc-e06eec6330a2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:37.030200 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-4c6065b3-2a9d-46f3-bddc-e06eec6330a2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:37.048635 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4c6065b3-2a9d-46f3-bddc-e06eec6330a2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:37.062218 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4c6065b3-2a9d-46f3-bddc-e06eec6330a2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:37.073604 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4c6065b3-2a9d-46f3-bddc-e06eec6330a2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:37.074610 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4c6065b3-2a9d-46f3-bddc-e06eec6330a2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:37.422518 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-4c6065b3-2a9d-46f3-bddc-e06eec6330a2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:37.435509 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-4c6065b3-2a9d-46f3-bddc-e06eec6330a2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1225 microversion: 2.1 time: 0.408938 Nov 23 14:30:37.438996 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 18/28] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:37 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1225 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:37.560601 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5345f051-7fce-41ef-b408-11949c67fd19 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:37.574682 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5345f051-7fce-41ef-b408-11949c67fd19 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.766782 Nov 23 14:30:37.581146 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 11/29] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:36 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:38.249936 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-554a9545-61c3-4af5-8bf7-a799ae68ae1d req-be68d559-92cd-4ac7-9eef-aec08c9af7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd32f487-0ba1-4203-b38d-e8c98996571b", "tag": "13c1d6ed-047c-49db-9ca5-88949c465a08"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:30:38.252460 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:30:38.252460 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:30:38.285916 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-554a9545-61c3-4af5-8bf7-a799ae68ae1d req-be68d559-92cd-4ac7-9eef-aec08c9af7a7 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:38.286561 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-554a9545-61c3-4af5-8bf7-a799ae68ae1d req-be68d559-92cd-4ac7-9eef-aec08c9af7a7 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:38.357417 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-554a9545-61c3-4af5-8bf7-a799ae68ae1d req-be68d559-92cd-4ac7-9eef-aec08c9af7a7 service nova] Creating event network-changed:13c1d6ed-047c-49db-9ca5-88949c465a08 for instance fd32f487-0ba1-4203-b38d-e8c98996571b on hv-cinder-80475 Nov 23 14:30:38.362878 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-554a9545-61c3-4af5-8bf7-a799ae68ae1d req-be68d559-92cd-4ac7-9eef-aec08c9af7a7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 23 14:30:38.364776 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8fb68b25-6021-4f36-b481-ddb5577c0135 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:38.368439 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8fb68b25-6021-4f36-b481-ddb5577c0135 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:38.372214 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8fb68b25-6021-4f36-b481-ddb5577c0135 None None] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:38.373067 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8fb68b25-6021-4f36-b481-ddb5577c0135 None None] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:38.400834 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.compute.rpcapi [None req-8fb68b25-6021-4f36-b481-ddb5577c0135 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 23 14:30:38.402954 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8fb68b25-6021-4f36-b481-ddb5577c0135 None None] Releasing lock "compute-rpcapi-router" {{(pid=116788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 23 14:30:38.455962 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-643862f7-6065-4b79-91b1-2e8d4bdb40f9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:38.459078 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-643862f7-6065-4b79-91b1-2e8d4bdb40f9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:38.490492 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-643862f7-6065-4b79-91b1-2e8d4bdb40f9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:38.490952 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-643862f7-6065-4b79-91b1-2e8d4bdb40f9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:38.491442 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-8fb68b25-6021-4f36-b481-ddb5577c0135 None None] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.050270 Nov 23 14:30:38.491744 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-643862f7-6065-4b79-91b1-2e8d4bdb40f9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:38.492186 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-643862f7-6065-4b79-91b1-2e8d4bdb40f9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:38.492609 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 19/30] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:30:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:30:38.599397 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-af947ea5-ef2d-40e9-a4f2-64c00cad38ea tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:38.600324 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-af947ea5-ef2d-40e9-a4f2-64c00cad38ea tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:38.621392 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-af947ea5-ef2d-40e9-a4f2-64c00cad38ea tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:38.634275 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-af947ea5-ef2d-40e9-a4f2-64c00cad38ea tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:38.634275 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-af947ea5-ef2d-40e9-a4f2-64c00cad38ea tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:38.634275 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-af947ea5-ef2d-40e9-a4f2-64c00cad38ea tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:39.015812 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-643862f7-6065-4b79-91b1-2e8d4bdb40f9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:39.036174 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-643862f7-6065-4b79-91b1-2e8d4bdb40f9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1273 microversion: 2.1 time: 0.582219 Nov 23 14:30:39.040230 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 12/31] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:38 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1273 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:30:39.767323 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-af947ea5-ef2d-40e9-a4f2-64c00cad38ea tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:39.784640 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-af947ea5-ef2d-40e9-a4f2-64c00cad38ea tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 1.191970 Nov 23 14:30:39.785633 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 20/32] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:38 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:40.058686 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f4789f60-8e4f-453d-ab43-a89e95361216 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:40.059498 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f4789f60-8e4f-453d-ab43-a89e95361216 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:40.072659 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f4789f60-8e4f-453d-ab43-a89e95361216 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:40.074496 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f4789f60-8e4f-453d-ab43-a89e95361216 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:40.079018 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f4789f60-8e4f-453d-ab43-a89e95361216 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:40.079932 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f4789f60-8e4f-453d-ab43-a89e95361216 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:40.571862 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f4789f60-8e4f-453d-ab43-a89e95361216 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:40.592923 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f4789f60-8e4f-453d-ab43-a89e95361216 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1291 microversion: 2.1 time: 0.535661 Nov 23 14:30:40.595411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 13/33] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:40 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1291 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:40.803048 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3edd11f6-95e9-4de5-b4f4-6f1387e2708f tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:40.809087 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3edd11f6-95e9-4de5-b4f4-6f1387e2708f tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:40.818935 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3edd11f6-95e9-4de5-b4f4-6f1387e2708f tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:40.822686 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3edd11f6-95e9-4de5-b4f4-6f1387e2708f tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:40.823634 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3edd11f6-95e9-4de5-b4f4-6f1387e2708f tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:40.826690 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3edd11f6-95e9-4de5-b4f4-6f1387e2708f tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:41.493272 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-3edd11f6-95e9-4de5-b4f4-6f1387e2708f tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:41.502723 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3edd11f6-95e9-4de5-b4f4-6f1387e2708f tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.703473 Nov 23 14:30:41.513240 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 21/34] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:40 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:41.620094 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7d4b7ffe-3092-4b4f-8852-6414fcbf7a0e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:41.621600 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7d4b7ffe-3092-4b4f-8852-6414fcbf7a0e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:41.647728 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7d4b7ffe-3092-4b4f-8852-6414fcbf7a0e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:41.650202 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7d4b7ffe-3092-4b4f-8852-6414fcbf7a0e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:41.653168 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7d4b7ffe-3092-4b4f-8852-6414fcbf7a0e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:41.657131 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7d4b7ffe-3092-4b4f-8852-6414fcbf7a0e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:41.986322 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7d4b7ffe-3092-4b4f-8852-6414fcbf7a0e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:41.997682 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7d4b7ffe-3092-4b4f-8852-6414fcbf7a0e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1279 microversion: 2.1 time: 0.387887 Nov 23 14:30:42.001631 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 14/35] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:41 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1279 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:42.558036 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5d36d420-72c1-4592-afef-1120d956de22 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:42.558036 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5d36d420-72c1-4592-afef-1120d956de22 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:42.558036 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5d36d420-72c1-4592-afef-1120d956de22 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:42.558036 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5d36d420-72c1-4592-afef-1120d956de22 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:42.559286 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5d36d420-72c1-4592-afef-1120d956de22 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:42.559286 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5d36d420-72c1-4592-afef-1120d956de22 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:42.784803 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5d36d420-72c1-4592-afef-1120d956de22 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:42.796681 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5d36d420-72c1-4592-afef-1120d956de22 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.280555 Nov 23 14:30:42.826165 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 22/36] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:42 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:43.031877 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-84952c4a-898d-4150-9f72-a36f681337e9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:43.035826 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-84952c4a-898d-4150-9f72-a36f681337e9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:43.044595 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84952c4a-898d-4150-9f72-a36f681337e9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:43.048070 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84952c4a-898d-4150-9f72-a36f681337e9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:43.049403 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84952c4a-898d-4150-9f72-a36f681337e9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:43.051489 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84952c4a-898d-4150-9f72-a36f681337e9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:43.156333 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7ec65a19-6283-4152-a9a5-9631ca712009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1296369673", "imageRef": "b06b9241-c147-436d-86bb-7c49ad8ef09c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e99f3395-6821-450f-8990-3416439c902b"}], "security_groups": [{"name": "tempest-securitygroup--2019036522"}], "key_name": "tempest-keypair-907714560", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:30:43.236565 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-84952c4a-898d-4150-9f72-a36f681337e9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:43.244673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-84952c4a-898d-4150-9f72-a36f681337e9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1279 microversion: 2.1 time: 0.227501 Nov 23 14:30:43.253283 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 15/37] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:43 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1279 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:43.514596 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.network.neutron [None req-7ec65a19-6283-4152-a9a5-9631ca712009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] validate_networks() for [('e99f3395-6821-450f-8990-3416439c902b', None, None, None, None, None)] {{(pid=116788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:30:43.831643 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4c11bb7a-ec09-4469-8584-db65c34065bc tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:43.832631 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4c11bb7a-ec09-4469-8584-db65c34065bc tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:43.852004 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4c11bb7a-ec09-4469-8584-db65c34065bc tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:43.852962 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4c11bb7a-ec09-4469-8584-db65c34065bc tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:43.854634 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4c11bb7a-ec09-4469-8584-db65c34065bc tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:43.856846 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4c11bb7a-ec09-4469-8584-db65c34065bc tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:44.551324 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4c11bb7a-ec09-4469-8584-db65c34065bc tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:44.589751 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4c11bb7a-ec09-4469-8584-db65c34065bc tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.757668 Nov 23 14:30:44.595461 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 16/38] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:43 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:30:44.596614 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2dd2c532-560a-4017-ad5c-1aac2b3d6598 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:44.598040 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2dd2c532-560a-4017-ad5c-1aac2b3d6598 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:44.607571 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2dd2c532-560a-4017-ad5c-1aac2b3d6598 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:44.610542 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2dd2c532-560a-4017-ad5c-1aac2b3d6598 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:44.611544 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2dd2c532-560a-4017-ad5c-1aac2b3d6598 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:44.612352 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2dd2c532-560a-4017-ad5c-1aac2b3d6598 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:44.739917 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-7ec65a19-6283-4152-a9a5-9631ca712009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Flavor limits 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:30:44.741035 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-7ec65a19-6283-4152-a9a5-9631ca712009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Image limits 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:30:44.741523 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-7ec65a19-6283-4152-a9a5-9631ca712009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Flavor pref 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:30:44.741936 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-7ec65a19-6283-4152-a9a5-9631ca712009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Image pref 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:30:44.742346 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-7ec65a19-6283-4152-a9a5-9631ca712009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:30:44.762008 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ec65a19-6283-4152-a9a5-9631ca712009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:44.763408 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ec65a19-6283-4152-a9a5-9631ca712009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:44.765292 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ec65a19-6283-4152-a9a5-9631ca712009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:44.770473 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ec65a19-6283-4152-a9a5-9631ca712009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:44.816425 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-7ec65a19-6283-4152-a9a5-9631ca712009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Getting quotas for project 45e139a46b8d40e4a8a321403730eb71. Resources: {'instances', 'cores', 'ram'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:30:44.821717 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-7ec65a19-6283-4152-a9a5-9631ca712009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Getting quotas for user 641f2f7ca87d4245a59f2dbe7b98759a and project 45e139a46b8d40e4a8a321403730eb71. Resources: {'instances', 'cores', 'ram'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:30:44.861002 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7ec65a19-6283-4152-a9a5-9631ca712009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Going to run 1 instances... {{(pid=116788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:30:44.863777 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7ec65a19-6283-4152-a9a5-9631ca712009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b06b9241-c147-436d-86bb-7c49ad8ef09c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:30:45.036178 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7ec65a19-6283-4152-a9a5-9631ca712009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.885224 Nov 23 14:30:45.042959 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 23/39] 10.222.0.82 () {62 vars in 1187 bytes} [Tue Nov 23 14:30:43 2021] POST /compute/v2.1/servers => generated 402 bytes in 1889 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 23 14:30:45.056075 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-0760a022-1617-4f6a-a6d6-42550705add0 req-40af7a38-3a49-4111-9957-4e32b0ddd2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6058aa9c-7bfb-4762-8055-36d2f3e29234", "tag": "41917fa8-aec8-4d67-b659-2bd33221e38a"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:30:45.058482 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:30:45.058482 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:30:45.081016 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-0760a022-1617-4f6a-a6d6-42550705add0 req-40af7a38-3a49-4111-9957-4e32b0ddd2b0 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:45.087599 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-0760a022-1617-4f6a-a6d6-42550705add0 req-40af7a38-3a49-4111-9957-4e32b0ddd2b0 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:45.116168 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-0760a022-1617-4f6a-a6d6-42550705add0 req-40af7a38-3a49-4111-9957-4e32b0ddd2b0 service nova] Creating event network-changed:41917fa8-aec8-4d67-b659-2bd33221e38a for instance 6058aa9c-7bfb-4762-8055-36d2f3e29234 on hv-cinder-80475 Nov 23 14:30:45.127692 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-0760a022-1617-4f6a-a6d6-42550705add0 req-40af7a38-3a49-4111-9957-4e32b0ddd2b0 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085052 Nov 23 14:30:45.131589 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 24/40] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:30:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:30:45.143107 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b8142240-05ee-4e79-b621-71f21b929cdc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:45.146084 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b8142240-05ee-4e79-b621-71f21b929cdc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:45.255130 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-b8142240-05ee-4e79-b621-71f21b929cdc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:45.271721 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-b8142240-05ee-4e79-b621-71f21b929cdc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:45.277502 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-b8142240-05ee-4e79-b621-71f21b929cdc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:45.278672 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b8142240-05ee-4e79-b621-71f21b929cdc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1281 microversion: 2.20 time: 0.145255 Nov 23 14:30:45.282712 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 25/41] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:30:45 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1281 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:30:45.297905 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c18bb9de-add3-4d0a-950c-20eaf34c6554 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1445305701", "imageRef": "b06b9241-c147-436d-86bb-7c49ad8ef09c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75dee0cb-c425-47a6-a181-354dcf25b3e5"}], "security_groups": [{"name": "tempest-securitygroup--2131968502"}], "key_name": "tempest-keypair-1765117141", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:30:45.547734 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2dd2c532-560a-4017-ad5c-1aac2b3d6598 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:45.557083 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2dd2c532-560a-4017-ad5c-1aac2b3d6598 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.965065 Nov 23 14:30:45.560192 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 17/42] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:44 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:45.584707 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.network.neutron [None req-c18bb9de-add3-4d0a-950c-20eaf34c6554 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] validate_networks() for [('75dee0cb-c425-47a6-a181-354dcf25b3e5', None, None, None, None, None)] {{(pid=116788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:30:45.607519 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f9086903-b649-4eba-9203-c1d812341fc0 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:45.608373 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f9086903-b649-4eba-9203-c1d812341fc0 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:45.621673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f9086903-b649-4eba-9203-c1d812341fc0 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:45.622127 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f9086903-b649-4eba-9203-c1d812341fc0 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:45.627037 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f9086903-b649-4eba-9203-c1d812341fc0 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:45.627675 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f9086903-b649-4eba-9203-c1d812341fc0 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:45.818977 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f9086903-b649-4eba-9203-c1d812341fc0 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:45.840053 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f9086903-b649-4eba-9203-c1d812341fc0 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.233182 Nov 23 14:30:45.840053 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 18/43] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:45 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:46.107614 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-c18bb9de-add3-4d0a-950c-20eaf34c6554 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Flavor limits 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:30:46.108471 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-c18bb9de-add3-4d0a-950c-20eaf34c6554 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Image limits 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:30:46.109285 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-c18bb9de-add3-4d0a-950c-20eaf34c6554 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Flavor pref 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:30:46.109931 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-c18bb9de-add3-4d0a-950c-20eaf34c6554 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Image pref 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:30:46.111277 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-c18bb9de-add3-4d0a-950c-20eaf34c6554 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:30:46.122715 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c18bb9de-add3-4d0a-950c-20eaf34c6554 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:46.123167 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c18bb9de-add3-4d0a-950c-20eaf34c6554 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:46.124543 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c18bb9de-add3-4d0a-950c-20eaf34c6554 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:46.124962 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c18bb9de-add3-4d0a-950c-20eaf34c6554 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:46.145159 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-c18bb9de-add3-4d0a-950c-20eaf34c6554 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Getting quotas for project 6cd08103499348da976aa1b8d926a748. Resources: {'instances', 'cores', 'ram'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:30:46.149246 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-c18bb9de-add3-4d0a-950c-20eaf34c6554 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Getting quotas for user 65b0720c8f9b47888a5e315c01ac65bb and project 6cd08103499348da976aa1b8d926a748. Resources: {'instances', 'cores', 'ram'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:30:46.161680 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c18bb9de-add3-4d0a-950c-20eaf34c6554 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Going to run 1 instances... {{(pid=116788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:30:46.166476 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c18bb9de-add3-4d0a-950c-20eaf34c6554 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b06b9241-c147-436d-86bb-7c49ad8ef09c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:30:46.301864 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-509d9e77-ce66-4a25-b61f-54d66b9f7a5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:46.302914 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-509d9e77-ce66-4a25-b61f-54d66b9f7a5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:46.364250 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c18bb9de-add3-4d0a-950c-20eaf34c6554 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.078216 Nov 23 14:30:46.378430 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 26/44] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:30:45 2021] POST /compute/v2.1/servers => generated 402 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 14:30:46.388636 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-92ec5cee-72fe-42bd-95b0-ef769ba861c3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:46.390312 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-92ec5cee-72fe-42bd-95b0-ef769ba861c3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:46.510745 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-92ec5cee-72fe-42bd-95b0-ef769ba861c3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:46.523924 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-509d9e77-ce66-4a25-b61f-54d66b9f7a5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:46.534589 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-509d9e77-ce66-4a25-b61f-54d66b9f7a5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:46.537336 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-509d9e77-ce66-4a25-b61f-54d66b9f7a5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:46.538528 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-92ec5cee-72fe-42bd-95b0-ef769ba861c3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1238 microversion: 2.1 time: 0.158776 Nov 23 14:30:46.539337 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 27/45] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:46 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1238 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:46.540890 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-509d9e77-ce66-4a25-b61f-54d66b9f7a5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1281 microversion: 2.20 time: 0.246505 Nov 23 14:30:46.554333 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 19/46] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:30:46 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1281 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:30:46.594813 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d327e6bb-3ff5-4c0e-8a87-614792879316 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:46.594813 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d327e6bb-3ff5-4c0e-8a87-614792879316 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:46.611062 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d327e6bb-3ff5-4c0e-8a87-614792879316 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:46.611516 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d327e6bb-3ff5-4c0e-8a87-614792879316 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:46.617144 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d327e6bb-3ff5-4c0e-8a87-614792879316 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:46.621774 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d327e6bb-3ff5-4c0e-8a87-614792879316 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:46.862886 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-196fb2e6-7566-45ae-b840-074eb3fa0fb1 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:46.865594 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-196fb2e6-7566-45ae-b840-074eb3fa0fb1 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:46.875728 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-196fb2e6-7566-45ae-b840-074eb3fa0fb1 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:46.877341 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-196fb2e6-7566-45ae-b840-074eb3fa0fb1 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:46.878477 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-196fb2e6-7566-45ae-b840-074eb3fa0fb1 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:46.879146 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-196fb2e6-7566-45ae-b840-074eb3fa0fb1 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:47.268617 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d327e6bb-3ff5-4c0e-8a87-614792879316 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:47.319156 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-196fb2e6-7566-45ae-b840-074eb3fa0fb1 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:47.319910 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d327e6bb-3ff5-4c0e-8a87-614792879316 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.700048 Nov 23 14:30:47.319910 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 28/47] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:46 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:47.320159 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-196fb2e6-7566-45ae-b840-074eb3fa0fb1 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.436315 Nov 23 14:30:47.320159 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 20/48] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:46 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:47.558940 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-0336652c-c199-4340-9d48-26348f726918 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:47.559835 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-0336652c-c199-4340-9d48-26348f726918 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:47.566512 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-07d28a21-8b19-4299-902e-80ec1a042946 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:47.567422 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-07d28a21-8b19-4299-902e-80ec1a042946 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:47.569102 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0336652c-c199-4340-9d48-26348f726918 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:47.572918 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0336652c-c199-4340-9d48-26348f726918 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:47.572918 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0336652c-c199-4340-9d48-26348f726918 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:47.572918 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0336652c-c199-4340-9d48-26348f726918 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:47.689386 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-0336652c-c199-4340-9d48-26348f726918 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:47.704978 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-0336652c-c199-4340-9d48-26348f726918 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:47.706689 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-0336652c-c199-4340-9d48-26348f726918 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:47.707823 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-0336652c-c199-4340-9d48-26348f726918 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1277 microversion: 2.20 time: 0.152731 Nov 23 14:30:47.713619 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 29/49] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:30:47 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:30:47.804432 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-07d28a21-8b19-4299-902e-80ec1a042946 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:47.813482 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-07d28a21-8b19-4299-902e-80ec1a042946 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1238 microversion: 2.1 time: 0.250577 Nov 23 14:30:47.819124 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 21/50] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:47 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1238 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:48.232723 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-5f42f22f-de01-4151-bef5-cdd637cb713d req-0a8160aa-ab3f-4641-9a69-5a6602d25a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3240fe59-76d8-41ec-b0b5-42e56aa99597", "tag": "a1493c8d-1347-413a-a2df-021ced559963"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:30:48.234792 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:30:48.234792 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:30:48.245070 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-5f42f22f-de01-4151-bef5-cdd637cb713d req-0a8160aa-ab3f-4641-9a69-5a6602d25a65 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:48.247754 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-5f42f22f-de01-4151-bef5-cdd637cb713d req-0a8160aa-ab3f-4641-9a69-5a6602d25a65 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:48.269356 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-5f42f22f-de01-4151-bef5-cdd637cb713d req-0a8160aa-ab3f-4641-9a69-5a6602d25a65 service nova] Creating event network-changed:a1493c8d-1347-413a-a2df-021ced559963 for instance 3240fe59-76d8-41ec-b0b5-42e56aa99597 on hv-cinder-80475 Nov 23 14:30:48.292675 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-5f42f22f-de01-4151-bef5-cdd637cb713d req-0a8160aa-ab3f-4641-9a69-5a6602d25a65 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065241 Nov 23 14:30:48.297998 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 30/51] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:30:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:30:48.320545 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b15d69b1-501c-411c-8d9a-853c65d8c525 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:48.321277 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d9ce7a9a-f972-41d4-84e7-f27684f79f99 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:48.321978 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d9ce7a9a-f972-41d4-84e7-f27684f79f99 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:48.322348 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b15d69b1-501c-411c-8d9a-853c65d8c525 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:48.333263 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b15d69b1-501c-411c-8d9a-853c65d8c525 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:48.336734 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b15d69b1-501c-411c-8d9a-853c65d8c525 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:48.337727 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b15d69b1-501c-411c-8d9a-853c65d8c525 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:48.340253 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b15d69b1-501c-411c-8d9a-853c65d8c525 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:48.357068 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d9ce7a9a-f972-41d4-84e7-f27684f79f99 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:48.365060 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d9ce7a9a-f972-41d4-84e7-f27684f79f99 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:48.367418 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d9ce7a9a-f972-41d4-84e7-f27684f79f99 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:48.372930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d9ce7a9a-f972-41d4-84e7-f27684f79f99 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:48.872874 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-b15d69b1-501c-411c-8d9a-853c65d8c525 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:48.884389 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b15d69b1-501c-411c-8d9a-853c65d8c525 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.567611 Nov 23 14:30:48.885876 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 31/52] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:48 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:48.893607 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1157ea8d-a4ca-4775-9b93-b2a5c972a926 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:48.896071 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1157ea8d-a4ca-4775-9b93-b2a5c972a926 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:48.913932 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1157ea8d-a4ca-4775-9b93-b2a5c972a926 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:48.914747 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1157ea8d-a4ca-4775-9b93-b2a5c972a926 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:48.915927 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1157ea8d-a4ca-4775-9b93-b2a5c972a926 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:48.919843 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1157ea8d-a4ca-4775-9b93-b2a5c972a926 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:49.080844 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1157ea8d-a4ca-4775-9b93-b2a5c972a926 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:49.105764 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1157ea8d-a4ca-4775-9b93-b2a5c972a926 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:49.109552 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1157ea8d-a4ca-4775-9b93-b2a5c972a926 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:49.112837 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1157ea8d-a4ca-4775-9b93-b2a5c972a926 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1341 microversion: 2.20 time: 0.224599 Nov 23 14:30:49.113588 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 32/53] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:30:48 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1341 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:30:49.139085 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-82a4857b-984c-4637-8359-1f6a15dc1b7d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:49.141371 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-82a4857b-984c-4637-8359-1f6a15dc1b7d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:49.158568 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-82a4857b-984c-4637-8359-1f6a15dc1b7d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:49.160299 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-82a4857b-984c-4637-8359-1f6a15dc1b7d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:49.160299 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-82a4857b-984c-4637-8359-1f6a15dc1b7d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:49.166902 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-82a4857b-984c-4637-8359-1f6a15dc1b7d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:49.243067 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d9ce7a9a-f972-41d4-84e7-f27684f79f99 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:49.262242 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d9ce7a9a-f972-41d4-84e7-f27684f79f99 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.940295 Nov 23 14:30:49.263178 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 22/54] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:48 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:49.299316 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-82a4857b-984c-4637-8359-1f6a15dc1b7d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:49.312458 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-82a4857b-984c-4637-8359-1f6a15dc1b7d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1290 microversion: 2.1 time: 0.183945 Nov 23 14:30:49.317332 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 33/55] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:49 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1290 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:49.902138 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-30ad1da5-f9e7-4c41-aa06-6519fbca2d47 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:49.903547 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-30ad1da5-f9e7-4c41-aa06-6519fbca2d47 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:49.910944 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-30ad1da5-f9e7-4c41-aa06-6519fbca2d47 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:49.911408 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-30ad1da5-f9e7-4c41-aa06-6519fbca2d47 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:49.924851 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-30ad1da5-f9e7-4c41-aa06-6519fbca2d47 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:49.925458 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-30ad1da5-f9e7-4c41-aa06-6519fbca2d47 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:50.135933 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9ad4f124-2abf-4848-85e6-91dc4dc09557 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:50.137130 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9ad4f124-2abf-4848-85e6-91dc4dc09557 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:50.146656 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9ad4f124-2abf-4848-85e6-91dc4dc09557 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:50.150838 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9ad4f124-2abf-4848-85e6-91dc4dc09557 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:50.164028 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9ad4f124-2abf-4848-85e6-91dc4dc09557 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:50.167450 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9ad4f124-2abf-4848-85e6-91dc4dc09557 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:50.346837 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9ad4f124-2abf-4848-85e6-91dc4dc09557 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:50.355334 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9ad4f124-2abf-4848-85e6-91dc4dc09557 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:50.356941 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9ad4f124-2abf-4848-85e6-91dc4dc09557 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:50.358580 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9ad4f124-2abf-4848-85e6-91dc4dc09557 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1339 microversion: 2.20 time: 0.225777 Nov 23 14:30:50.359148 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 34/56] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:30:50 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1339 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:30:50.372826 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-2b2f0464-7870-49e6-8f85-ff1ee26a3490 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:50.380175 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-2b2f0464-7870-49e6-8f85-ff1ee26a3490 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:50.389184 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2b2f0464-7870-49e6-8f85-ff1ee26a3490 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:50.391341 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2b2f0464-7870-49e6-8f85-ff1ee26a3490 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:50.393035 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2b2f0464-7870-49e6-8f85-ff1ee26a3490 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:50.394544 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2b2f0464-7870-49e6-8f85-ff1ee26a3490 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:50.576660 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-30ad1da5-f9e7-4c41-aa06-6519fbca2d47 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:50.588360 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-30ad1da5-f9e7-4c41-aa06-6519fbca2d47 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.689956 Nov 23 14:30:50.589196 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 23/57] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:49 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:50.598432 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e364c5e2-1e03-48a6-923b-cb64fc661ac9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:50.602950 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e364c5e2-1e03-48a6-923b-cb64fc661ac9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:50.617650 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e364c5e2-1e03-48a6-923b-cb64fc661ac9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:50.618440 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e364c5e2-1e03-48a6-923b-cb64fc661ac9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:50.620099 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e364c5e2-1e03-48a6-923b-cb64fc661ac9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:50.620779 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e364c5e2-1e03-48a6-923b-cb64fc661ac9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:50.793123 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e364c5e2-1e03-48a6-923b-cb64fc661ac9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:50.807590 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e364c5e2-1e03-48a6-923b-cb64fc661ac9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1296 microversion: 2.1 time: 0.217109 Nov 23 14:30:50.816380 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 24/58] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:50 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1296 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:50.872110 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-2b2f0464-7870-49e6-8f85-ff1ee26a3490 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:50.884603 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-2b2f0464-7870-49e6-8f85-ff1ee26a3490 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.524374 Nov 23 14:30:50.885495 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 35/59] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:50 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:51.392603 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f1405c3b-2f30-42de-a465-e1b28aedb5ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:51.392603 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f1405c3b-2f30-42de-a465-e1b28aedb5ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:51.396996 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f1405c3b-2f30-42de-a465-e1b28aedb5ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:51.397739 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f1405c3b-2f30-42de-a465-e1b28aedb5ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:51.398555 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f1405c3b-2f30-42de-a465-e1b28aedb5ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:51.399343 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f1405c3b-2f30-42de-a465-e1b28aedb5ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:51.623406 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-822e928e-6c5b-44d7-8d36-0920d358bfa6 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:51.626259 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-822e928e-6c5b-44d7-8d36-0920d358bfa6 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:51.658693 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-822e928e-6c5b-44d7-8d36-0920d358bfa6 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:51.659145 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-822e928e-6c5b-44d7-8d36-0920d358bfa6 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:51.659971 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-822e928e-6c5b-44d7-8d36-0920d358bfa6 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:51.684168 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-822e928e-6c5b-44d7-8d36-0920d358bfa6 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:51.982538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f1405c3b-2f30-42de-a465-e1b28aedb5ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:51.991633 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f1405c3b-2f30-42de-a465-e1b28aedb5ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:52.001720 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f1405c3b-2f30-42de-a465-e1b28aedb5ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:52.007822 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f1405c3b-2f30-42de-a465-e1b28aedb5ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.626787 Nov 23 14:30:52.010570 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 25/60] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:30:51 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:30:52.015195 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3d488c58-828d-490b-a18e-d5c772268080 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:52.023655 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3d488c58-828d-490b-a18e-d5c772268080 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:52.039645 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3d488c58-828d-490b-a18e-d5c772268080 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:52.056501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3d488c58-828d-490b-a18e-d5c772268080 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:52.056501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3d488c58-828d-490b-a18e-d5c772268080 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:52.056501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3d488c58-828d-490b-a18e-d5c772268080 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:52.253375 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-822e928e-6c5b-44d7-8d36-0920d358bfa6 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:52.261924 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-822e928e-6c5b-44d7-8d36-0920d358bfa6 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.656723 Nov 23 14:30:52.275294 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 36/61] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:51 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:52.281370 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ade4a990-ae72-4535-a373-2691c93cfb4b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:52.282475 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ade4a990-ae72-4535-a373-2691c93cfb4b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:52.296304 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ade4a990-ae72-4535-a373-2691c93cfb4b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:52.297177 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ade4a990-ae72-4535-a373-2691c93cfb4b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:52.298152 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ade4a990-ae72-4535-a373-2691c93cfb4b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:52.301607 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ade4a990-ae72-4535-a373-2691c93cfb4b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:52.555462 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3d488c58-828d-490b-a18e-d5c772268080 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:52.565284 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3d488c58-828d-490b-a18e-d5c772268080 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1364 microversion: 2.1 time: 0.553124 Nov 23 14:30:52.566093 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 26/62] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:52 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1364 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:53.008095 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ade4a990-ae72-4535-a373-2691c93cfb4b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:53.041842 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ade4a990-ae72-4535-a373-2691c93cfb4b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.755914 Nov 23 14:30:53.053196 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 37/63] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:52 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:53.066555 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6a579938-7d23-48e1-b6ce-935833f8ef1a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:53.069004 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6a579938-7d23-48e1-b6ce-935833f8ef1a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:53.097519 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a579938-7d23-48e1-b6ce-935833f8ef1a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:53.098849 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a579938-7d23-48e1-b6ce-935833f8ef1a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:53.101472 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a579938-7d23-48e1-b6ce-935833f8ef1a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:53.105401 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a579938-7d23-48e1-b6ce-935833f8ef1a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:53.291498 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a7f19352-6433-4413-8d57-33de3bd6414e tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:53.292529 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a7f19352-6433-4413-8d57-33de3bd6414e tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:53.327566 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a7f19352-6433-4413-8d57-33de3bd6414e tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:53.328337 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a7f19352-6433-4413-8d57-33de3bd6414e tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:53.329370 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a7f19352-6433-4413-8d57-33de3bd6414e tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:53.330319 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a7f19352-6433-4413-8d57-33de3bd6414e tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:53.457494 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6a579938-7d23-48e1-b6ce-935833f8ef1a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:53.466326 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6a579938-7d23-48e1-b6ce-935833f8ef1a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:53.468110 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6a579938-7d23-48e1-b6ce-935833f8ef1a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:53.476975 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6a579938-7d23-48e1-b6ce-935833f8ef1a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.452570 Nov 23 14:30:53.477592 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 27/64] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:30:53 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:30:53.490419 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-cac8f4ee-28b3-4e77-8f0e-7f5d562c493d req-fe80c4ba-96b7-4480-a135-238f98362d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c8dbd0-2f80-4158-923b-24f263fd9832", "tag": "643c4469-7e07-47b2-806d-0dfc74abe378"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:30:53.498036 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:30:53.498036 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:30:53.524781 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-cac8f4ee-28b3-4e77-8f0e-7f5d562c493d req-fe80c4ba-96b7-4480-a135-238f98362d8a service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:53.525621 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-cac8f4ee-28b3-4e77-8f0e-7f5d562c493d req-fe80c4ba-96b7-4480-a135-238f98362d8a service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:53.579397 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-cac8f4ee-28b3-4e77-8f0e-7f5d562c493d req-fe80c4ba-96b7-4480-a135-238f98362d8a service nova] Creating event network-changed:643c4469-7e07-47b2-806d-0dfc74abe378 for instance f5c8dbd0-2f80-4158-923b-24f263fd9832 on hv-cinder-80475 Nov 23 14:30:53.580008 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-cac8f4ee-28b3-4e77-8f0e-7f5d562c493d req-fe80c4ba-96b7-4480-a135-238f98362d8a service nova] Acquired lock "compute-rpcapi-router" {{(pid=116787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 23 14:30:53.581210 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0acc6e37-3094-4a3f-a6a9-95c94adfd050 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:53.581745 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0acc6e37-3094-4a3f-a6a9-95c94adfd050 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:53.582576 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0acc6e37-3094-4a3f-a6a9-95c94adfd050 None None] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:53.582987 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0acc6e37-3094-4a3f-a6a9-95c94adfd050 None None] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:53.607897 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.compute.rpcapi [None req-0acc6e37-3094-4a3f-a6a9-95c94adfd050 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 23 14:30:53.609311 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0acc6e37-3094-4a3f-a6a9-95c94adfd050 None None] Releasing lock "compute-rpcapi-router" {{(pid=116787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 23 14:30:53.665377 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0acc6e37-3094-4a3f-a6a9-95c94adfd050 None None] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184108 Nov 23 14:30:53.666234 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 28/65] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:30:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:30:53.676662 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f40e1d7a-c46e-4936-8ffe-59167333b8fe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:53.677536 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f40e1d7a-c46e-4936-8ffe-59167333b8fe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:53.686909 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f40e1d7a-c46e-4936-8ffe-59167333b8fe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:53.687355 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f40e1d7a-c46e-4936-8ffe-59167333b8fe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:53.688137 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f40e1d7a-c46e-4936-8ffe-59167333b8fe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:53.690571 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f40e1d7a-c46e-4936-8ffe-59167333b8fe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:53.821354 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a7f19352-6433-4413-8d57-33de3bd6414e tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:53.845280 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a7f19352-6433-4413-8d57-33de3bd6414e tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.562776 Nov 23 14:30:53.846224 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 38/66] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:53 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:53.931384 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f40e1d7a-c46e-4936-8ffe-59167333b8fe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:53.940506 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f40e1d7a-c46e-4936-8ffe-59167333b8fe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1364 microversion: 2.1 time: 0.272900 Nov 23 14:30:53.941294 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 29/67] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:53 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:54.144986 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-785eea7e-523a-4b04-8021-a72076b9aeab tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:54.145618 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-785eea7e-523a-4b04-8021-a72076b9aeab tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:54.152397 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-785eea7e-523a-4b04-8021-a72076b9aeab tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:54.152939 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-785eea7e-523a-4b04-8021-a72076b9aeab tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:54.153621 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-785eea7e-523a-4b04-8021-a72076b9aeab tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:54.154055 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-785eea7e-523a-4b04-8021-a72076b9aeab tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:54.496934 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9c25a9f9-db3b-41f6-ada1-5672742c7c88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:54.497674 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9c25a9f9-db3b-41f6-ada1-5672742c7c88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:54.509080 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9c25a9f9-db3b-41f6-ada1-5672742c7c88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:54.509729 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9c25a9f9-db3b-41f6-ada1-5672742c7c88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:54.510791 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9c25a9f9-db3b-41f6-ada1-5672742c7c88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:54.511495 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9c25a9f9-db3b-41f6-ada1-5672742c7c88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:54.526321 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-785eea7e-523a-4b04-8021-a72076b9aeab tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:54.538792 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-785eea7e-523a-4b04-8021-a72076b9aeab tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.396326 Nov 23 14:30:54.540409 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 39/68] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:54 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:30:54.720674 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9c25a9f9-db3b-41f6-ada1-5672742c7c88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:54.728949 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9c25a9f9-db3b-41f6-ada1-5672742c7c88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:54.730689 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9c25a9f9-db3b-41f6-ada1-5672742c7c88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:54.734200 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9c25a9f9-db3b-41f6-ada1-5672742c7c88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.241786 Nov 23 14:30:54.735479 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 30/69] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:30:54 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:30:54.767462 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-1fc36204-2e24-49d4-b7c2-482d038f2144 req-30be3f44-4680-4625-a486-a78d3bf0a078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace5aa86-e88f-49e1-b497-966c499eba99", "tag": "ede71cd5-6bc1-4eed-a9a6-c4d4c9fe08fc"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:30:54.771882 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:30:54.771882 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:30:54.780366 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-1fc36204-2e24-49d4-b7c2-482d038f2144 req-30be3f44-4680-4625-a486-a78d3bf0a078 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:54.781035 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-1fc36204-2e24-49d4-b7c2-482d038f2144 req-30be3f44-4680-4625-a486-a78d3bf0a078 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:54.793447 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-1fc36204-2e24-49d4-b7c2-482d038f2144 req-30be3f44-4680-4625-a486-a78d3bf0a078 service nova] Creating event network-changed:ede71cd5-6bc1-4eed-a9a6-c4d4c9fe08fc for instance ace5aa86-e88f-49e1-b497-966c499eba99 on hv-cinder-80475 Nov 23 14:30:54.802067 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-1fc36204-2e24-49d4-b7c2-482d038f2144 req-30be3f44-4680-4625-a486-a78d3bf0a078 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247995 Nov 23 14:30:54.802806 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 40/70] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:30:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:30:54.862977 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e1a203dc-7eff-471c-8166-14f9acb9a8ed tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:54.863798 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e1a203dc-7eff-471c-8166-14f9acb9a8ed tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:54.869741 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e1a203dc-7eff-471c-8166-14f9acb9a8ed tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:54.870446 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e1a203dc-7eff-471c-8166-14f9acb9a8ed tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:54.871417 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e1a203dc-7eff-471c-8166-14f9acb9a8ed tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:54.872000 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e1a203dc-7eff-471c-8166-14f9acb9a8ed tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:54.958085 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-02f52ce1-693e-4b93-958b-15773bb47276 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:54.959154 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-02f52ce1-693e-4b93-958b-15773bb47276 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:54.969393 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-02f52ce1-693e-4b93-958b-15773bb47276 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:54.970765 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-02f52ce1-693e-4b93-958b-15773bb47276 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:54.972142 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-02f52ce1-693e-4b93-958b-15773bb47276 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:54.972896 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-02f52ce1-693e-4b93-958b-15773bb47276 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:55.052151 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e1a203dc-7eff-471c-8166-14f9acb9a8ed tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:55.063739 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e1a203dc-7eff-471c-8166-14f9acb9a8ed tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.205388 Nov 23 14:30:55.074983 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 31/71] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:54 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:55.228689 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-02f52ce1-693e-4b93-958b-15773bb47276 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:55.236982 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-02f52ce1-693e-4b93-958b-15773bb47276 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1364 microversion: 2.1 time: 0.283221 Nov 23 14:30:55.237716 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 41/72] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:54 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1364 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:55.556155 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9009fe0d-ded5-40bf-93e7-e7b0d8b47251 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:55.556791 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9009fe0d-ded5-40bf-93e7-e7b0d8b47251 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:55.562785 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9009fe0d-ded5-40bf-93e7-e7b0d8b47251 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:55.563236 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9009fe0d-ded5-40bf-93e7-e7b0d8b47251 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:55.563998 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9009fe0d-ded5-40bf-93e7-e7b0d8b47251 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:55.564452 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9009fe0d-ded5-40bf-93e7-e7b0d8b47251 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:55.755002 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-928cebac-5975-423e-9cc3-861fe9906d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:55.755870 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-928cebac-5975-423e-9cc3-861fe9906d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:55.766114 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-928cebac-5975-423e-9cc3-861fe9906d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:55.766798 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-928cebac-5975-423e-9cc3-861fe9906d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:55.767761 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-928cebac-5975-423e-9cc3-861fe9906d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:55.769477 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-928cebac-5975-423e-9cc3-861fe9906d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:55.827867 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9009fe0d-ded5-40bf-93e7-e7b0d8b47251 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:55.851329 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9009fe0d-ded5-40bf-93e7-e7b0d8b47251 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.295410 Nov 23 14:30:55.854805 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 32/73] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:55 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:55.932830 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-928cebac-5975-423e-9cc3-861fe9906d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:55.942750 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-928cebac-5975-423e-9cc3-861fe9906d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:55.944286 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-928cebac-5975-423e-9cc3-861fe9906d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:55.945414 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-928cebac-5975-423e-9cc3-861fe9906d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.194937 Nov 23 14:30:55.946608 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 42/74] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:30:55 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:30:56.094681 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c4b34d59-03cb-4675-b1a8-9ecc5e845d97 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:56.096949 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c4b34d59-03cb-4675-b1a8-9ecc5e845d97 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:56.124773 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c4b34d59-03cb-4675-b1a8-9ecc5e845d97 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:56.124773 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c4b34d59-03cb-4675-b1a8-9ecc5e845d97 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:56.124773 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c4b34d59-03cb-4675-b1a8-9ecc5e845d97 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:56.124773 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c4b34d59-03cb-4675-b1a8-9ecc5e845d97 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:56.257367 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b0472327-e8ff-41df-803b-841b8172f8fa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:56.258523 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b0472327-e8ff-41df-803b-841b8172f8fa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:56.293595 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b0472327-e8ff-41df-803b-841b8172f8fa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:56.293595 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b0472327-e8ff-41df-803b-841b8172f8fa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:56.293595 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b0472327-e8ff-41df-803b-841b8172f8fa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:56.293595 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b0472327-e8ff-41df-803b-841b8172f8fa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:56.439169 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c4b34d59-03cb-4675-b1a8-9ecc5e845d97 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:56.451063 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c4b34d59-03cb-4675-b1a8-9ecc5e845d97 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.370937 Nov 23 14:30:56.456406 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 33/75] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:56 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:56.533448 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-b0472327-e8ff-41df-803b-841b8172f8fa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:56.541021 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b0472327-e8ff-41df-803b-841b8172f8fa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1364 microversion: 2.1 time: 0.290284 Nov 23 14:30:56.541786 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 43/76] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:56 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1364 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:56.871882 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-16a57277-f384-4cb1-b079-d06c03c625ef tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:56.873105 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-16a57277-f384-4cb1-b079-d06c03c625ef tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:56.882159 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-16a57277-f384-4cb1-b079-d06c03c625ef tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:56.882694 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-16a57277-f384-4cb1-b079-d06c03c625ef tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:56.883492 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-16a57277-f384-4cb1-b079-d06c03c625ef tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:56.883952 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-16a57277-f384-4cb1-b079-d06c03c625ef tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:56.966538 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-76d6ef50-fb59-414c-910e-722cc62fce42 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:56.966538 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-76d6ef50-fb59-414c-910e-722cc62fce42 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:56.973750 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-76d6ef50-fb59-414c-910e-722cc62fce42 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:56.974404 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-76d6ef50-fb59-414c-910e-722cc62fce42 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:56.975661 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-76d6ef50-fb59-414c-910e-722cc62fce42 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:56.976181 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-76d6ef50-fb59-414c-910e-722cc62fce42 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:57.051972 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-16a57277-f384-4cb1-b079-d06c03c625ef tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:57.059555 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-16a57277-f384-4cb1-b079-d06c03c625ef tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.192210 Nov 23 14:30:57.060124 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 34/77] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:56 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:57.140086 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-76d6ef50-fb59-414c-910e-722cc62fce42 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:57.153517 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-76d6ef50-fb59-414c-910e-722cc62fce42 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:57.155204 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-76d6ef50-fb59-414c-910e-722cc62fce42 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:57.161638 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-76d6ef50-fb59-414c-910e-722cc62fce42 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.201405 Nov 23 14:30:57.162640 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 44/78] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:30:56 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:30:57.468059 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ea7e11a8-5255-4da9-9eed-a7309f8c18da tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:57.468730 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ea7e11a8-5255-4da9-9eed-a7309f8c18da tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:57.474512 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ea7e11a8-5255-4da9-9eed-a7309f8c18da tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:57.474957 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ea7e11a8-5255-4da9-9eed-a7309f8c18da tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:57.475728 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ea7e11a8-5255-4da9-9eed-a7309f8c18da tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:57.476158 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ea7e11a8-5255-4da9-9eed-a7309f8c18da tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:57.560929 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6877d725-dd07-425f-a963-61f74f24b12a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:57.562265 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6877d725-dd07-425f-a963-61f74f24b12a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:57.568645 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6877d725-dd07-425f-a963-61f74f24b12a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:57.569382 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6877d725-dd07-425f-a963-61f74f24b12a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:57.570355 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6877d725-dd07-425f-a963-61f74f24b12a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:57.571001 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6877d725-dd07-425f-a963-61f74f24b12a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:57.613238 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ea7e11a8-5255-4da9-9eed-a7309f8c18da tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:57.621552 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ea7e11a8-5255-4da9-9eed-a7309f8c18da tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.157146 Nov 23 14:30:57.622140 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 35/79] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:57 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:57.711715 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6877d725-dd07-425f-a963-61f74f24b12a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:57.720287 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6877d725-dd07-425f-a963-61f74f24b12a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1364 microversion: 2.1 time: 0.163170 Nov 23 14:30:57.720861 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 45/80] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:57 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:30:58.079300 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c834f47c-fe7d-4d61-8f09-9c10593e95f0 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:58.081469 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c834f47c-fe7d-4d61-8f09-9c10593e95f0 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:58.087930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c834f47c-fe7d-4d61-8f09-9c10593e95f0 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:58.088402 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c834f47c-fe7d-4d61-8f09-9c10593e95f0 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:58.089575 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c834f47c-fe7d-4d61-8f09-9c10593e95f0 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:58.090164 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c834f47c-fe7d-4d61-8f09-9c10593e95f0 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:58.188872 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ea0fff57-c30b-4774-958d-536198328922 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:58.192466 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ea0fff57-c30b-4774-958d-536198328922 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:58.199709 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ea0fff57-c30b-4774-958d-536198328922 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:58.200151 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ea0fff57-c30b-4774-958d-536198328922 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:58.200984 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ea0fff57-c30b-4774-958d-536198328922 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:58.201468 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ea0fff57-c30b-4774-958d-536198328922 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:58.262815 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c834f47c-fe7d-4d61-8f09-9c10593e95f0 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:58.272780 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c834f47c-fe7d-4d61-8f09-9c10593e95f0 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.199288 Nov 23 14:30:58.283261 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 36/81] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:58 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:58.352485 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ea0fff57-c30b-4774-958d-536198328922 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:58.367375 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ea0fff57-c30b-4774-958d-536198328922 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:58.367375 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ea0fff57-c30b-4774-958d-536198328922 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:58.367375 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ea0fff57-c30b-4774-958d-536198328922 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.188521 Nov 23 14:30:58.367672 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 46/82] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:30:58 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:30:58.638579 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-85c717e0-3a16-4eb5-9eaa-d0b870360a22 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:58.639987 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-85c717e0-3a16-4eb5-9eaa-d0b870360a22 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:58.646236 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-85c717e0-3a16-4eb5-9eaa-d0b870360a22 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:58.646677 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-85c717e0-3a16-4eb5-9eaa-d0b870360a22 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:58.647435 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-85c717e0-3a16-4eb5-9eaa-d0b870360a22 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:58.648017 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-85c717e0-3a16-4eb5-9eaa-d0b870360a22 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:58.737356 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-96f1567e-dd79-49a4-9292-a39ee7c65d0a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:58.738591 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-96f1567e-dd79-49a4-9292-a39ee7c65d0a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:58.747379 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-96f1567e-dd79-49a4-9292-a39ee7c65d0a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:58.747930 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-96f1567e-dd79-49a4-9292-a39ee7c65d0a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:58.748943 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-96f1567e-dd79-49a4-9292-a39ee7c65d0a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:58.749447 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-96f1567e-dd79-49a4-9292-a39ee7c65d0a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:58.787715 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-85c717e0-3a16-4eb5-9eaa-d0b870360a22 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:58.795114 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-85c717e0-3a16-4eb5-9eaa-d0b870360a22 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.160072 Nov 23 14:30:58.796060 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 37/83] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:58 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:58.886675 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-96f1567e-dd79-49a4-9292-a39ee7c65d0a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:58.894578 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-96f1567e-dd79-49a4-9292-a39ee7c65d0a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1364 microversion: 2.1 time: 0.161220 Nov 23 14:30:58.895142 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 47/84] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:58 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:59.290377 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3a79a587-a05b-4389-9fbc-b788d86c47fb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:59.290989 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3a79a587-a05b-4389-9fbc-b788d86c47fb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:59.297984 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3a79a587-a05b-4389-9fbc-b788d86c47fb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:59.298456 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3a79a587-a05b-4389-9fbc-b788d86c47fb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:59.299248 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3a79a587-a05b-4389-9fbc-b788d86c47fb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:59.299681 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3a79a587-a05b-4389-9fbc-b788d86c47fb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:59.384327 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-0ba08225-d8b2-4024-8e69-5431fea22c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:59.384824 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-0ba08225-d8b2-4024-8e69-5431fea22c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:59.392831 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0ba08225-d8b2-4024-8e69-5431fea22c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:59.393280 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0ba08225-d8b2-4024-8e69-5431fea22c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:59.394058 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0ba08225-d8b2-4024-8e69-5431fea22c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:59.394490 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0ba08225-d8b2-4024-8e69-5431fea22c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:59.551609 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-0ba08225-d8b2-4024-8e69-5431fea22c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:59.560054 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-0ba08225-d8b2-4024-8e69-5431fea22c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:59.562946 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-0ba08225-d8b2-4024-8e69-5431fea22c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:59.564097 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-0ba08225-d8b2-4024-8e69-5431fea22c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.183635 Nov 23 14:30:59.564692 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 48/85] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:30:59 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:30:59.632080 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3a79a587-a05b-4389-9fbc-b788d86c47fb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:59.639229 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3a79a587-a05b-4389-9fbc-b788d86c47fb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.352633 Nov 23 14:30:59.639981 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 38/86] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:59 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:30:59.811176 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e5a1da67-37b1-4612-8ee3-829bc6054041 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:59.811841 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e5a1da67-37b1-4612-8ee3-829bc6054041 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:59.817756 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e5a1da67-37b1-4612-8ee3-829bc6054041 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:59.818202 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e5a1da67-37b1-4612-8ee3-829bc6054041 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:59.818962 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e5a1da67-37b1-4612-8ee3-829bc6054041 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:59.819386 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e5a1da67-37b1-4612-8ee3-829bc6054041 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:59.914694 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-fbdd8c55-0302-4ae4-97a7-3a22dfd716ab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:30:59.916110 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-fbdd8c55-0302-4ae4-97a7-3a22dfd716ab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:30:59.924712 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fbdd8c55-0302-4ae4-97a7-3a22dfd716ab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:59.925241 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fbdd8c55-0302-4ae4-97a7-3a22dfd716ab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:59.926096 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fbdd8c55-0302-4ae4-97a7-3a22dfd716ab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:30:59.926599 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fbdd8c55-0302-4ae4-97a7-3a22dfd716ab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:30:59.961360 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e5a1da67-37b1-4612-8ee3-829bc6054041 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:30:59.970083 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e5a1da67-37b1-4612-8ee3-829bc6054041 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.162392 Nov 23 14:30:59.970666 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 49/87] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:59 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:00.092095 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-fbdd8c55-0302-4ae4-97a7-3a22dfd716ab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:00.100376 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-fbdd8c55-0302-4ae4-97a7-3a22dfd716ab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1364 microversion: 2.1 time: 0.191753 Nov 23 14:31:00.100953 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 39/88] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:30:59 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:00.583054 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-74ef4520-200a-41e5-9353-1789c7cb89c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:00.583880 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-74ef4520-200a-41e5-9353-1789c7cb89c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:00.591344 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-74ef4520-200a-41e5-9353-1789c7cb89c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:00.605255 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-74ef4520-200a-41e5-9353-1789c7cb89c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:00.605255 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-74ef4520-200a-41e5-9353-1789c7cb89c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:00.605255 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-74ef4520-200a-41e5-9353-1789c7cb89c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:00.656600 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-269efb7f-eebf-4f5c-857d-0442d319451c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:00.657473 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-269efb7f-eebf-4f5c-857d-0442d319451c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:00.670027 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-269efb7f-eebf-4f5c-857d-0442d319451c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:00.670748 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-269efb7f-eebf-4f5c-857d-0442d319451c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:00.672050 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-269efb7f-eebf-4f5c-857d-0442d319451c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:00.672666 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-269efb7f-eebf-4f5c-857d-0442d319451c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:00.905415 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-74ef4520-200a-41e5-9353-1789c7cb89c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:00.915134 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-74ef4520-200a-41e5-9353-1789c7cb89c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:00.916635 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-74ef4520-200a-41e5-9353-1789c7cb89c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:00.917727 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-74ef4520-200a-41e5-9353-1789c7cb89c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.338535 Nov 23 14:31:00.918290 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 50/89] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:31:00 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:31:00.944376 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-269efb7f-eebf-4f5c-857d-0442d319451c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:00.951480 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-269efb7f-eebf-4f5c-857d-0442d319451c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.299254 Nov 23 14:31:00.952107 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 40/90] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:00 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:00.987398 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-11fc6594-1e89-4e4c-b1e1-6f74aea16820 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:00.988204 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-11fc6594-1e89-4e4c-b1e1-6f74aea16820 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:00.994276 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-11fc6594-1e89-4e4c-b1e1-6f74aea16820 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:00.994717 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-11fc6594-1e89-4e4c-b1e1-6f74aea16820 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:00.995529 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-11fc6594-1e89-4e4c-b1e1-6f74aea16820 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:00.995899 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-11fc6594-1e89-4e4c-b1e1-6f74aea16820 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:01.116564 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f07f42c1-7102-467f-a1f7-dd29837ffd55 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:01.117612 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f07f42c1-7102-467f-a1f7-dd29837ffd55 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:01.123605 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f07f42c1-7102-467f-a1f7-dd29837ffd55 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:01.124432 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f07f42c1-7102-467f-a1f7-dd29837ffd55 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:01.125227 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f07f42c1-7102-467f-a1f7-dd29837ffd55 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:01.125835 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f07f42c1-7102-467f-a1f7-dd29837ffd55 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:01.221794 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-11fc6594-1e89-4e4c-b1e1-6f74aea16820 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:01.229473 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-11fc6594-1e89-4e4c-b1e1-6f74aea16820 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.246460 Nov 23 14:31:01.230242 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 51/91] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:00 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:01.300603 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f07f42c1-7102-467f-a1f7-dd29837ffd55 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:01.312613 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f07f42c1-7102-467f-a1f7-dd29837ffd55 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1364 microversion: 2.1 time: 0.198090 Nov 23 14:31:01.313529 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 41/92] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:01 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:01.936156 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ada50839-537a-42a1-938e-cd5ca80d9244 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:01.937986 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ada50839-537a-42a1-938e-cd5ca80d9244 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:01.943794 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ada50839-537a-42a1-938e-cd5ca80d9244 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:01.944253 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ada50839-537a-42a1-938e-cd5ca80d9244 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:01.945070 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ada50839-537a-42a1-938e-cd5ca80d9244 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:01.945663 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ada50839-537a-42a1-938e-cd5ca80d9244 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:01.969068 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ec00b685-2700-4ee3-a188-2f2657c5de09 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:01.969808 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ec00b685-2700-4ee3-a188-2f2657c5de09 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:01.975655 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ec00b685-2700-4ee3-a188-2f2657c5de09 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:01.976099 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ec00b685-2700-4ee3-a188-2f2657c5de09 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:01.976935 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ec00b685-2700-4ee3-a188-2f2657c5de09 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:01.977320 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ec00b685-2700-4ee3-a188-2f2657c5de09 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:02.089276 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ada50839-537a-42a1-938e-cd5ca80d9244 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:02.097633 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ada50839-537a-42a1-938e-cd5ca80d9244 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:02.099061 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ada50839-537a-42a1-938e-cd5ca80d9244 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:02.100335 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ada50839-537a-42a1-938e-cd5ca80d9244 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.167981 Nov 23 14:31:02.101369 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 52/93] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:31:01 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:31:02.116856 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ec00b685-2700-4ee3-a188-2f2657c5de09 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:02.125058 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ec00b685-2700-4ee3-a188-2f2657c5de09 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.159187 Nov 23 14:31:02.125689 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 42/94] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:01 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:02.245533 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-98064c97-2c82-4bf0-bccc-7b0589449985 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:02.246280 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-98064c97-2c82-4bf0-bccc-7b0589449985 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:02.252940 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-98064c97-2c82-4bf0-bccc-7b0589449985 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:02.253472 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-98064c97-2c82-4bf0-bccc-7b0589449985 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:02.254252 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-98064c97-2c82-4bf0-bccc-7b0589449985 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:02.254681 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-98064c97-2c82-4bf0-bccc-7b0589449985 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:02.330109 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-604be977-9b8e-4114-b5e5-f2bac3bd7eb2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:02.331475 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-604be977-9b8e-4114-b5e5-f2bac3bd7eb2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:02.340926 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-604be977-9b8e-4114-b5e5-f2bac3bd7eb2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:02.341501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-604be977-9b8e-4114-b5e5-f2bac3bd7eb2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:02.342438 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-604be977-9b8e-4114-b5e5-f2bac3bd7eb2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:02.343592 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-604be977-9b8e-4114-b5e5-f2bac3bd7eb2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:02.429713 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-98064c97-2c82-4bf0-bccc-7b0589449985 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:02.438006 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-98064c97-2c82-4bf0-bccc-7b0589449985 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.195691 Nov 23 14:31:02.455885 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 53/95] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:02 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:02.527049 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-604be977-9b8e-4114-b5e5-f2bac3bd7eb2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:02.536617 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-604be977-9b8e-4114-b5e5-f2bac3bd7eb2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1364 microversion: 2.1 time: 0.210444 Nov 23 14:31:02.537366 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 43/96] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:02 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:03.118690 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c1fde513-ab3b-4413-ab7d-5278fb5a2d7f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:03.124774 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c1fde513-ab3b-4413-ab7d-5278fb5a2d7f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:03.126081 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c1fde513-ab3b-4413-ab7d-5278fb5a2d7f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:03.126703 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c1fde513-ab3b-4413-ab7d-5278fb5a2d7f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:03.127517 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c1fde513-ab3b-4413-ab7d-5278fb5a2d7f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:03.127945 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c1fde513-ab3b-4413-ab7d-5278fb5a2d7f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:03.142102 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a85ac4c3-53df-4730-802f-49ba1ea8432d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:03.143402 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a85ac4c3-53df-4730-802f-49ba1ea8432d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:03.171852 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a85ac4c3-53df-4730-802f-49ba1ea8432d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:03.172783 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a85ac4c3-53df-4730-802f-49ba1ea8432d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:03.174203 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a85ac4c3-53df-4730-802f-49ba1ea8432d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:03.175058 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a85ac4c3-53df-4730-802f-49ba1ea8432d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:03.313901 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c1fde513-ab3b-4413-ab7d-5278fb5a2d7f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:03.322056 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c1fde513-ab3b-4413-ab7d-5278fb5a2d7f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:03.324341 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c1fde513-ab3b-4413-ab7d-5278fb5a2d7f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:03.325675 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c1fde513-ab3b-4413-ab7d-5278fb5a2d7f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.210640 Nov 23 14:31:03.328800 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 54/97] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:31:03 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:31:03.370946 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a85ac4c3-53df-4730-802f-49ba1ea8432d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:03.379649 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a85ac4c3-53df-4730-802f-49ba1ea8432d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.241394 Nov 23 14:31:03.380302 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 44/98] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:03 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:03.463026 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-63906953-4855-4fa4-99af-328b9e75691c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:03.463621 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-63906953-4855-4fa4-99af-328b9e75691c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:03.469519 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-63906953-4855-4fa4-99af-328b9e75691c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:03.469963 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-63906953-4855-4fa4-99af-328b9e75691c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:03.470724 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-63906953-4855-4fa4-99af-328b9e75691c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:03.471149 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-63906953-4855-4fa4-99af-328b9e75691c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:03.553997 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d28d3f7a-a6ac-4719-b3e6-bd85b9554eb7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:03.554621 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d28d3f7a-a6ac-4719-b3e6-bd85b9554eb7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:03.562744 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d28d3f7a-a6ac-4719-b3e6-bd85b9554eb7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:03.563189 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d28d3f7a-a6ac-4719-b3e6-bd85b9554eb7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:03.563975 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d28d3f7a-a6ac-4719-b3e6-bd85b9554eb7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:03.564454 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d28d3f7a-a6ac-4719-b3e6-bd85b9554eb7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:03.659637 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-63906953-4855-4fa4-99af-328b9e75691c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:03.667721 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-63906953-4855-4fa4-99af-328b9e75691c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.208129 Nov 23 14:31:03.668633 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 55/99] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:03 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:03.751806 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d28d3f7a-a6ac-4719-b3e6-bd85b9554eb7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:03.759073 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d28d3f7a-a6ac-4719-b3e6-bd85b9554eb7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1364 microversion: 2.1 time: 0.208839 Nov 23 14:31:03.759634 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 45/100] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:03 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:04.345553 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5f16d009-2ccf-43ab-b5bb-74a311114f99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:04.347238 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5f16d009-2ccf-43ab-b5bb-74a311114f99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:04.353500 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5f16d009-2ccf-43ab-b5bb-74a311114f99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:04.354128 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5f16d009-2ccf-43ab-b5bb-74a311114f99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:04.355157 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5f16d009-2ccf-43ab-b5bb-74a311114f99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:04.355790 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5f16d009-2ccf-43ab-b5bb-74a311114f99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:04.396352 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-dfeaa4c3-c014-44fe-b6f3-4828e26c6e28 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:04.396961 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-dfeaa4c3-c014-44fe-b6f3-4828e26c6e28 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:04.402789 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dfeaa4c3-c014-44fe-b6f3-4828e26c6e28 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:04.403254 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dfeaa4c3-c014-44fe-b6f3-4828e26c6e28 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:04.404018 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dfeaa4c3-c014-44fe-b6f3-4828e26c6e28 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:04.404490 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dfeaa4c3-c014-44fe-b6f3-4828e26c6e28 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:04.550240 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5f16d009-2ccf-43ab-b5bb-74a311114f99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:04.557292 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-dfeaa4c3-c014-44fe-b6f3-4828e26c6e28 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:04.559293 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5f16d009-2ccf-43ab-b5bb-74a311114f99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:04.560807 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5f16d009-2ccf-43ab-b5bb-74a311114f99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:04.562029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5f16d009-2ccf-43ab-b5bb-74a311114f99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.221339 Nov 23 14:31:04.563042 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 56/101] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:31:04 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:31:04.575354 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-dfeaa4c3-c014-44fe-b6f3-4828e26c6e28 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.182535 Nov 23 14:31:04.576040 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 46/102] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:04 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:04.684813 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e1fdc6b9-391f-478b-9f1e-97cc41ec6406 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:04.685552 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e1fdc6b9-391f-478b-9f1e-97cc41ec6406 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:04.692072 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e1fdc6b9-391f-478b-9f1e-97cc41ec6406 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:04.692616 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e1fdc6b9-391f-478b-9f1e-97cc41ec6406 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:04.693488 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e1fdc6b9-391f-478b-9f1e-97cc41ec6406 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:04.694053 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e1fdc6b9-391f-478b-9f1e-97cc41ec6406 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:04.776012 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-dd3442b2-0f19-436d-804f-2347eb088a61 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:04.776902 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-dd3442b2-0f19-436d-804f-2347eb088a61 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:04.783990 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dd3442b2-0f19-436d-804f-2347eb088a61 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:04.784489 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dd3442b2-0f19-436d-804f-2347eb088a61 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:04.785439 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dd3442b2-0f19-436d-804f-2347eb088a61 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:04.785874 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dd3442b2-0f19-436d-804f-2347eb088a61 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:04.853100 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e1fdc6b9-391f-478b-9f1e-97cc41ec6406 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:04.866466 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e1fdc6b9-391f-478b-9f1e-97cc41ec6406 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.185573 Nov 23 14:31:04.875810 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 57/103] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:04 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:04.946676 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-dd3442b2-0f19-436d-804f-2347eb088a61 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:04.954530 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-dd3442b2-0f19-436d-804f-2347eb088a61 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1364 microversion: 2.1 time: 0.181978 Nov 23 14:31:04.954976 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 47/104] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:04 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:04.963372 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-7df31af0-a622-4ee5-bcd5-c75aa1094ecc req-0dbfe7d7-64ca-4862-b064-89aa31bd6163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6058aa9c-7bfb-4762-8055-36d2f3e29234", "name": "network-vif-plugged", "status": "completed", "tag": "41917fa8-aec8-4d67-b659-2bd33221e38a"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:04.965029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:31:04.965029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:31:04.972620 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-7df31af0-a622-4ee5-bcd5-c75aa1094ecc req-0dbfe7d7-64ca-4862-b064-89aa31bd6163 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:04.973064 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-7df31af0-a622-4ee5-bcd5-c75aa1094ecc req-0dbfe7d7-64ca-4862-b064-89aa31bd6163 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:04.984049 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-7df31af0-a622-4ee5-bcd5-c75aa1094ecc req-0dbfe7d7-64ca-4862-b064-89aa31bd6163 service nova] Creating event network-vif-plugged:41917fa8-aec8-4d67-b659-2bd33221e38a for instance 6058aa9c-7bfb-4762-8055-36d2f3e29234 on hv-cinder-80475 Nov 23 14:31:04.989122 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-7df31af0-a622-4ee5-bcd5-c75aa1094ecc req-0dbfe7d7-64ca-4862-b064-89aa31bd6163 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111001 Nov 23 14:31:04.989687 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 58/105] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:31:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:31:05.580652 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5026f5a1-3ea3-4026-aae5-294170e581e7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:05.581335 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5026f5a1-3ea3-4026-aae5-294170e581e7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:05.588196 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5026f5a1-3ea3-4026-aae5-294170e581e7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:05.588957 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5026f5a1-3ea3-4026-aae5-294170e581e7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:05.590292 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5026f5a1-3ea3-4026-aae5-294170e581e7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:05.591101 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5026f5a1-3ea3-4026-aae5-294170e581e7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:05.594270 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7e6015c4-7abb-4218-83e4-9672257e3579 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:05.594963 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7e6015c4-7abb-4218-83e4-9672257e3579 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:05.601330 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7e6015c4-7abb-4218-83e4-9672257e3579 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:05.601800 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7e6015c4-7abb-4218-83e4-9672257e3579 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:05.602563 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7e6015c4-7abb-4218-83e4-9672257e3579 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:05.602984 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7e6015c4-7abb-4218-83e4-9672257e3579 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:05.735825 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5026f5a1-3ea3-4026-aae5-294170e581e7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:05.744183 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5026f5a1-3ea3-4026-aae5-294170e581e7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:05.745710 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5026f5a1-3ea3-4026-aae5-294170e581e7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:05.747132 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5026f5a1-3ea3-4026-aae5-294170e581e7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.170771 Nov 23 14:31:05.754972 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 48/106] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:31:05 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:31:05.791483 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7e6015c4-7abb-4218-83e4-9672257e3579 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:05.799481 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7e6015c4-7abb-4218-83e4-9672257e3579 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.210006 Nov 23 14:31:05.803327 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 59/107] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:05 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:05.890735 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-53e98afc-ee74-4af4-bf16-02c2dad5c460 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:05.891338 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-53e98afc-ee74-4af4-bf16-02c2dad5c460 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:05.897354 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-53e98afc-ee74-4af4-bf16-02c2dad5c460 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:05.897790 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-53e98afc-ee74-4af4-bf16-02c2dad5c460 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:05.898608 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-53e98afc-ee74-4af4-bf16-02c2dad5c460 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:05.899069 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-53e98afc-ee74-4af4-bf16-02c2dad5c460 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:05.974659 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-08895aac-7d73-4436-97e0-d77a0004e1b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:05.982660 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-08895aac-7d73-4436-97e0-d77a0004e1b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:05.996918 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-08895aac-7d73-4436-97e0-d77a0004e1b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:05.996918 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-08895aac-7d73-4436-97e0-d77a0004e1b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:05.996918 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-08895aac-7d73-4436-97e0-d77a0004e1b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:05.997345 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-08895aac-7d73-4436-97e0-d77a0004e1b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:06.064297 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-53e98afc-ee74-4af4-bf16-02c2dad5c460 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:06.074663 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-53e98afc-ee74-4af4-bf16-02c2dad5c460 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.187784 Nov 23 14:31:06.075903 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 49/108] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:05 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:06.145976 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-08895aac-7d73-4436-97e0-d77a0004e1b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:06.153205 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-08895aac-7d73-4436-97e0-d77a0004e1b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1364 microversion: 2.1 time: 0.185579 Nov 23 14:31:06.153774 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 60/109] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:05 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:06.766106 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3bf42ef0-e5fd-4d4b-ac8e-3586331943b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:06.766708 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3bf42ef0-e5fd-4d4b-ac8e-3586331943b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:06.772919 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3bf42ef0-e5fd-4d4b-ac8e-3586331943b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:06.773364 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3bf42ef0-e5fd-4d4b-ac8e-3586331943b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:06.774142 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3bf42ef0-e5fd-4d4b-ac8e-3586331943b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:06.774569 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3bf42ef0-e5fd-4d4b-ac8e-3586331943b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:06.817559 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-683dc12d-a717-40a1-98e7-08827276b5a2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:06.819107 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-683dc12d-a717-40a1-98e7-08827276b5a2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:06.825937 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-683dc12d-a717-40a1-98e7-08827276b5a2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:06.826396 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-683dc12d-a717-40a1-98e7-08827276b5a2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:06.827716 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-683dc12d-a717-40a1-98e7-08827276b5a2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:06.828751 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-683dc12d-a717-40a1-98e7-08827276b5a2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:06.922480 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3bf42ef0-e5fd-4d4b-ac8e-3586331943b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:06.939543 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3bf42ef0-e5fd-4d4b-ac8e-3586331943b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:06.947295 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3bf42ef0-e5fd-4d4b-ac8e-3586331943b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:06.947295 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3bf42ef0-e5fd-4d4b-ac8e-3586331943b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.182370 Nov 23 14:31:06.947295 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 50/110] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:31:06 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:31:06.991275 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-683dc12d-a717-40a1-98e7-08827276b5a2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:06.999264 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-683dc12d-a717-40a1-98e7-08827276b5a2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.185319 Nov 23 14:31:07.003550 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-da2d9745-8528-4e44-97d1-0efb664241c9 req-da17e718-2e2f-4ed7-94db-60d998f665f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd32f487-0ba1-4203-b38d-e8c98996571b", "name": "network-vif-plugged", "status": "completed", "tag": "13c1d6ed-047c-49db-9ca5-88949c465a08"}, {"server_uuid": "3240fe59-76d8-41ec-b0b5-42e56aa99597", "name": "network-vif-plugged", "status": "completed", "tag": "a1493c8d-1347-413a-a2df-021ced559963"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:07.006596 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:31:07.006596 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:31:07.009166 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 61/111] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:06 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:07.014101 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-da2d9745-8528-4e44-97d1-0efb664241c9 req-da17e718-2e2f-4ed7-94db-60d998f665f9 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:07.015692 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-da2d9745-8528-4e44-97d1-0efb664241c9 req-da17e718-2e2f-4ed7-94db-60d998f665f9 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:07.027242 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-da2d9745-8528-4e44-97d1-0efb664241c9 req-da17e718-2e2f-4ed7-94db-60d998f665f9 service nova] Creating event network-vif-plugged:13c1d6ed-047c-49db-9ca5-88949c465a08 for instance fd32f487-0ba1-4203-b38d-e8c98996571b on hv-cinder-80475 Nov 23 14:31:07.027745 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-da2d9745-8528-4e44-97d1-0efb664241c9 req-da17e718-2e2f-4ed7-94db-60d998f665f9 service nova] Creating event network-vif-plugged:a1493c8d-1347-413a-a2df-021ced559963 for instance 3240fe59-76d8-41ec-b0b5-42e56aa99597 on hv-cinder-80475 Nov 23 14:31:07.034667 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-da2d9745-8528-4e44-97d1-0efb664241c9 req-da17e718-2e2f-4ed7-94db-60d998f665f9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034912 Nov 23 14:31:07.035343 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 51/112] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:31:06 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:31:07.092351 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d6e96185-79bc-46a3-b913-f9d0f7cdafe1 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:07.093603 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d6e96185-79bc-46a3-b913-f9d0f7cdafe1 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:07.100926 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d6e96185-79bc-46a3-b913-f9d0f7cdafe1 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:07.101697 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d6e96185-79bc-46a3-b913-f9d0f7cdafe1 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:07.102730 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d6e96185-79bc-46a3-b913-f9d0f7cdafe1 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:07.103289 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d6e96185-79bc-46a3-b913-f9d0f7cdafe1 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:07.171713 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-11dee5a2-7f2f-40ad-ad46-53a0164094d4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:07.176153 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-11dee5a2-7f2f-40ad-ad46-53a0164094d4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:07.189164 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-11dee5a2-7f2f-40ad-ad46-53a0164094d4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:07.194263 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-11dee5a2-7f2f-40ad-ad46-53a0164094d4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:07.195102 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-11dee5a2-7f2f-40ad-ad46-53a0164094d4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:07.196966 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-11dee5a2-7f2f-40ad-ad46-53a0164094d4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:07.401936 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d6e96185-79bc-46a3-b913-f9d0f7cdafe1 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:07.414273 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d6e96185-79bc-46a3-b913-f9d0f7cdafe1 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.325524 Nov 23 14:31:07.414963 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 62/113] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:07 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:07.498250 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-11dee5a2-7f2f-40ad-ad46-53a0164094d4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:07.507139 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-11dee5a2-7f2f-40ad-ad46-53a0164094d4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1364 microversion: 2.1 time: 0.339879 Nov 23 14:31:07.516348 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 52/114] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:07 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1364 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:07.962766 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a1adf450-7bc3-4123-ba41-7cdbbd31c9ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:07.963397 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a1adf450-7bc3-4123-ba41-7cdbbd31c9ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:07.970468 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a1adf450-7bc3-4123-ba41-7cdbbd31c9ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:07.970920 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a1adf450-7bc3-4123-ba41-7cdbbd31c9ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:07.971695 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a1adf450-7bc3-4123-ba41-7cdbbd31c9ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:07.972128 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a1adf450-7bc3-4123-ba41-7cdbbd31c9ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:08.015943 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6b95d715-2cd4-41aa-9d44-1b7f6fd0843b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:08.016568 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6b95d715-2cd4-41aa-9d44-1b7f6fd0843b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:08.022280 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6b95d715-2cd4-41aa-9d44-1b7f6fd0843b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:08.022717 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6b95d715-2cd4-41aa-9d44-1b7f6fd0843b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:08.023481 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6b95d715-2cd4-41aa-9d44-1b7f6fd0843b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:08.023908 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6b95d715-2cd4-41aa-9d44-1b7f6fd0843b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:08.145437 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a1adf450-7bc3-4123-ba41-7cdbbd31c9ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:08.153336 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a1adf450-7bc3-4123-ba41-7cdbbd31c9ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:08.155090 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a1adf450-7bc3-4123-ba41-7cdbbd31c9ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:08.158004 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a1adf450-7bc3-4123-ba41-7cdbbd31c9ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.199024 Nov 23 14:31:08.158886 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 63/115] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:31:07 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:31:08.191315 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6b95d715-2cd4-41aa-9d44-1b7f6fd0843b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:08.199741 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6b95d715-2cd4-41aa-9d44-1b7f6fd0843b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.187632 Nov 23 14:31:08.200368 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 53/116] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:08 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:08.430869 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-07ce08cc-49a4-469a-b1af-add1076b936c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:08.431476 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-07ce08cc-49a4-469a-b1af-add1076b936c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:08.439305 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-07ce08cc-49a4-469a-b1af-add1076b936c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:08.439924 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-07ce08cc-49a4-469a-b1af-add1076b936c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:08.441000 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-07ce08cc-49a4-469a-b1af-add1076b936c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:08.441635 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-07ce08cc-49a4-469a-b1af-add1076b936c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:08.524970 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d07dbe2b-e5b4-4e83-9109-129905ca30f9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:08.525940 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d07dbe2b-e5b4-4e83-9109-129905ca30f9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:08.535074 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d07dbe2b-e5b4-4e83-9109-129905ca30f9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:08.536169 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d07dbe2b-e5b4-4e83-9109-129905ca30f9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:08.537426 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d07dbe2b-e5b4-4e83-9109-129905ca30f9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:08.538159 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d07dbe2b-e5b4-4e83-9109-129905ca30f9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:08.641760 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-07ce08cc-49a4-469a-b1af-add1076b936c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:08.650823 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-07ce08cc-49a4-469a-b1af-add1076b936c tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.223758 Nov 23 14:31:08.651494 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 64/117] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:08 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:08.696961 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d07dbe2b-e5b4-4e83-9109-129905ca30f9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:08.704502 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d07dbe2b-e5b4-4e83-9109-129905ca30f9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1364 microversion: 2.1 time: 0.183378 Nov 23 14:31:08.705075 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 54/118] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:08 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:09.049664 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-366e7bb0-4484-4651-816b-89cebc358ddf req-ec4d31af-0415-4da3-8fbe-d30562574142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace5aa86-e88f-49e1-b497-966c499eba99", "name": "network-vif-plugged", "status": "completed", "tag": "ede71cd5-6bc1-4eed-a9a6-c4d4c9fe08fc"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:09.052021 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:31:09.052021 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:31:09.058941 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-366e7bb0-4484-4651-816b-89cebc358ddf req-ec4d31af-0415-4da3-8fbe-d30562574142 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:09.059380 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-366e7bb0-4484-4651-816b-89cebc358ddf req-ec4d31af-0415-4da3-8fbe-d30562574142 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:09.070419 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-366e7bb0-4484-4651-816b-89cebc358ddf req-ec4d31af-0415-4da3-8fbe-d30562574142 service nova] Creating event network-vif-plugged:ede71cd5-6bc1-4eed-a9a6-c4d4c9fe08fc for instance ace5aa86-e88f-49e1-b497-966c499eba99 on hv-cinder-80475 Nov 23 14:31:09.075373 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-366e7bb0-4484-4651-816b-89cebc358ddf req-ec4d31af-0415-4da3-8fbe-d30562574142 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029314 Nov 23 14:31:09.075967 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 65/119] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:31:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:31:09.183460 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-777583fa-d10e-489b-baa9-f2dea38c0775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:09.184021 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-777583fa-d10e-489b-baa9-f2dea38c0775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:09.192500 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-777583fa-d10e-489b-baa9-f2dea38c0775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:09.193185 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-777583fa-d10e-489b-baa9-f2dea38c0775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:09.193972 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-777583fa-d10e-489b-baa9-f2dea38c0775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:09.194430 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-777583fa-d10e-489b-baa9-f2dea38c0775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:09.217231 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c85980f8-e26a-401f-8366-075263a8db1d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:09.218809 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c85980f8-e26a-401f-8366-075263a8db1d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:09.225577 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c85980f8-e26a-401f-8366-075263a8db1d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:09.226396 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c85980f8-e26a-401f-8366-075263a8db1d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:09.227359 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c85980f8-e26a-401f-8366-075263a8db1d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:09.228002 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c85980f8-e26a-401f-8366-075263a8db1d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:09.353258 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-777583fa-d10e-489b-baa9-f2dea38c0775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:09.364441 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-777583fa-d10e-489b-baa9-f2dea38c0775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:09.376501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-777583fa-d10e-489b-baa9-f2dea38c0775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:09.376501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-777583fa-d10e-489b-baa9-f2dea38c0775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.193230 Nov 23 14:31:09.376721 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c85980f8-e26a-401f-8366-075263a8db1d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:09.378210 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 55/120] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:31:09 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:31:09.389369 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c85980f8-e26a-401f-8366-075263a8db1d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1321 microversion: 2.1 time: 0.176066 Nov 23 14:31:09.391526 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 66/121] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:09 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:09.668516 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c09e088f-e0d4-401f-bb44-b017cb7a722e tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:09.669121 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c09e088f-e0d4-401f-bb44-b017cb7a722e tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:09.676248 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c09e088f-e0d4-401f-bb44-b017cb7a722e tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:09.676850 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c09e088f-e0d4-401f-bb44-b017cb7a722e tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:09.677627 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c09e088f-e0d4-401f-bb44-b017cb7a722e tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:09.678054 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c09e088f-e0d4-401f-bb44-b017cb7a722e tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:09.721859 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-4ac5ab42-4015-4825-b871-2e828a9cb94f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:09.722654 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-4ac5ab42-4015-4825-b871-2e828a9cb94f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:09.728742 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4ac5ab42-4015-4825-b871-2e828a9cb94f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:09.729192 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4ac5ab42-4015-4825-b871-2e828a9cb94f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:09.729989 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4ac5ab42-4015-4825-b871-2e828a9cb94f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:09.730578 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4ac5ab42-4015-4825-b871-2e828a9cb94f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:09.850442 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c09e088f-e0d4-401f-bb44-b017cb7a722e tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:09.861300 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c09e088f-e0d4-401f-bb44-b017cb7a722e tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1315 microversion: 2.1 time: 0.196196 Nov 23 14:31:09.862216 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 56/122] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:09 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:10.073923 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-4ac5ab42-4015-4825-b871-2e828a9cb94f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:10.090179 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-4ac5ab42-4015-4825-b871-2e828a9cb94f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1364 microversion: 2.1 time: 0.366648 Nov 23 14:31:10.090179 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 67/123] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:09 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1364 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:10.385540 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e65f7ddc-ec4d-4c5c-afc7-32c40553b105 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:10.386136 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e65f7ddc-ec4d-4c5c-afc7-32c40553b105 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:10.392563 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e65f7ddc-ec4d-4c5c-afc7-32c40553b105 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:10.393011 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e65f7ddc-ec4d-4c5c-afc7-32c40553b105 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:10.393781 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e65f7ddc-ec4d-4c5c-afc7-32c40553b105 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:10.394225 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e65f7ddc-ec4d-4c5c-afc7-32c40553b105 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:10.410469 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-65eb8ca4-82cb-4f8b-ab1d-5eb14efca494 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:10.411063 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-65eb8ca4-82cb-4f8b-ab1d-5eb14efca494 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:10.416838 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-65eb8ca4-82cb-4f8b-ab1d-5eb14efca494 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:10.417280 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-65eb8ca4-82cb-4f8b-ab1d-5eb14efca494 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:10.418046 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-65eb8ca4-82cb-4f8b-ab1d-5eb14efca494 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:10.418473 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-65eb8ca4-82cb-4f8b-ab1d-5eb14efca494 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:10.574320 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e65f7ddc-ec4d-4c5c-afc7-32c40553b105 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:10.582964 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e65f7ddc-ec4d-4c5c-afc7-32c40553b105 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:10.584723 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e65f7ddc-ec4d-4c5c-afc7-32c40553b105 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:10.586034 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e65f7ddc-ec4d-4c5c-afc7-32c40553b105 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.204180 Nov 23 14:31:10.589782 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-65eb8ca4-82cb-4f8b-ab1d-5eb14efca494 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:10.596838 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 57/124] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:31:10 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:31:10.598629 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-65eb8ca4-82cb-4f8b-ab1d-5eb14efca494 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1514 microversion: 2.1 time: 0.191982 Nov 23 14:31:10.599471 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 68/125] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:10 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:10.616701 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c7d127d7-3034-4f27-998d-0c83a0723788 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:10.617919 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c7d127d7-3034-4f27-998d-0c83a0723788 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:10.624280 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c7d127d7-3034-4f27-998d-0c83a0723788 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:10.624718 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c7d127d7-3034-4f27-998d-0c83a0723788 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:10.625565 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c7d127d7-3034-4f27-998d-0c83a0723788 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:10.625910 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c7d127d7-3034-4f27-998d-0c83a0723788 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:10.691257 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-c7d127d7-3034-4f27-998d-0c83a0723788 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lazy-loading 'flavor' on Instance uuid 3240fe59-76d8-41ec-b0b5-42e56aa99597 {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:31:10.879200 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-17ee18d4-623e-4129-b26b-f18cecf39193 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:10.882586 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-17ee18d4-623e-4129-b26b-f18cecf39193 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:10.889328 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-17ee18d4-623e-4129-b26b-f18cecf39193 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:10.890770 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-17ee18d4-623e-4129-b26b-f18cecf39193 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:10.891581 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-17ee18d4-623e-4129-b26b-f18cecf39193 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:10.892015 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-17ee18d4-623e-4129-b26b-f18cecf39193 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:11.042420 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-17ee18d4-623e-4129-b26b-f18cecf39193 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:11.050196 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-17ee18d4-623e-4129-b26b-f18cecf39193 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1502 microversion: 2.1 time: 0.175060 Nov 23 14:31:11.064115 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 69/126] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:10 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1502 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:11.089887 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-7f9cbbb2-1f51-4af9-8219-540f45ebb672 req-76599fca-37a0-49d6-b006-cc75a0e9836d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c8dbd0-2f80-4158-923b-24f263fd9832", "name": "network-vif-plugged", "status": "completed", "tag": "643c4469-7e07-47b2-806d-0dfc74abe378"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:11.092079 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:31:11.092079 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:31:11.099504 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-7f9cbbb2-1f51-4af9-8219-540f45ebb672 req-76599fca-37a0-49d6-b006-cc75a0e9836d service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:11.100166 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-7f9cbbb2-1f51-4af9-8219-540f45ebb672 req-76599fca-37a0-49d6-b006-cc75a0e9836d service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:11.104536 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c7d127d7-3034-4f27-998d-0c83a0723788 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "POST /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597/action" status: 200 len: 32 microversion: 2.1 time: 0.491885 Nov 23 14:31:11.105346 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 58/127] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:10 2021] POST /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597/action => generated 32 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:31:11.112369 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8126b652-c104-4013-8c9e-c6785f8b037f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:11.114979 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8126b652-c104-4013-8c9e-c6785f8b037f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:11.119302 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-7f9cbbb2-1f51-4af9-8219-540f45ebb672 req-76599fca-37a0-49d6-b006-cc75a0e9836d service nova] Creating event network-vif-plugged:643c4469-7e07-47b2-806d-0dfc74abe378 for instance f5c8dbd0-2f80-4158-923b-24f263fd9832 on hv-cinder-80475 Nov 23 14:31:11.126342 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-7f9cbbb2-1f51-4af9-8219-540f45ebb672 req-76599fca-37a0-49d6-b006-cc75a0e9836d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039569 Nov 23 14:31:11.127684 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 70/128] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:31:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:31:11.137951 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5c6841d9-38b8-4ff7-9138-bde089fb54da tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:11.139505 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5c6841d9-38b8-4ff7-9138-bde089fb54da tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:11.146958 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8126b652-c104-4013-8c9e-c6785f8b037f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:11.148291 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5c6841d9-38b8-4ff7-9138-bde089fb54da tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:11.149104 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5c6841d9-38b8-4ff7-9138-bde089fb54da tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:11.150246 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5c6841d9-38b8-4ff7-9138-bde089fb54da tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:11.150920 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5c6841d9-38b8-4ff7-9138-bde089fb54da tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:11.152003 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8126b652-c104-4013-8c9e-c6785f8b037f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:11.153785 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8126b652-c104-4013-8c9e-c6785f8b037f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:11.155823 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8126b652-c104-4013-8c9e-c6785f8b037f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:11.402696 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5c6841d9-38b8-4ff7-9138-bde089fb54da tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:11.411122 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5c6841d9-38b8-4ff7-9138-bde089fb54da tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.278062 Nov 23 14:31:11.412011 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 71/129] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:11 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:11.566766 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-8126b652-c104-4013-8c9e-c6785f8b037f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:11.574522 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8126b652-c104-4013-8c9e-c6785f8b037f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1364 microversion: 2.1 time: 0.467864 Nov 23 14:31:11.575527 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 59/130] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:11 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1364 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:11.605093 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9648b828-534a-4802-a793-307ca315ee17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:11.606004 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9648b828-534a-4802-a793-307ca315ee17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:11.628878 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9648b828-534a-4802-a793-307ca315ee17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:11.629600 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9648b828-534a-4802-a793-307ca315ee17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:11.630631 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9648b828-534a-4802-a793-307ca315ee17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:11.631792 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9648b828-534a-4802-a793-307ca315ee17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:11.783358 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9648b828-534a-4802-a793-307ca315ee17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:11.798790 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9648b828-534a-4802-a793-307ca315ee17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:11.798790 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9648b828-534a-4802-a793-307ca315ee17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:11.799768 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9648b828-534a-4802-a793-307ca315ee17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.198605 Nov 23 14:31:11.800362 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 72/131] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:31:11 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:31:12.427673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-bed26287-c40f-409d-b45d-79933766719a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:12.428310 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-bed26287-c40f-409d-b45d-79933766719a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:12.434207 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bed26287-c40f-409d-b45d-79933766719a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:12.434728 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bed26287-c40f-409d-b45d-79933766719a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:12.435928 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bed26287-c40f-409d-b45d-79933766719a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:12.436579 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bed26287-c40f-409d-b45d-79933766719a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:12.592486 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-2acca589-39f5-425d-8062-126789463330 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:12.593709 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-2acca589-39f5-425d-8062-126789463330 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:12.602173 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2acca589-39f5-425d-8062-126789463330 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:12.602583 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2acca589-39f5-425d-8062-126789463330 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:12.603840 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2acca589-39f5-425d-8062-126789463330 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:12.604679 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2acca589-39f5-425d-8062-126789463330 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:12.645352 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-bed26287-c40f-409d-b45d-79933766719a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:12.652668 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-bed26287-c40f-409d-b45d-79933766719a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.228576 Nov 23 14:31:12.653237 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 60/132] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:12 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:12.749213 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-2acca589-39f5-425d-8062-126789463330 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:12.756503 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-2acca589-39f5-425d-8062-126789463330 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1550 microversion: 2.1 time: 0.167925 Nov 23 14:31:12.757060 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 73/133] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:12 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1550 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:12.781392 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-10a77c00-feca-40ff-a03c-f80c98404cc1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:12.781874 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-10a77c00-feca-40ff-a03c-f80c98404cc1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:12.788008 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-10a77c00-feca-40ff-a03c-f80c98404cc1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:12.788457 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-10a77c00-feca-40ff-a03c-f80c98404cc1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:12.789217 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-10a77c00-feca-40ff-a03c-f80c98404cc1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:12.789653 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-10a77c00-feca-40ff-a03c-f80c98404cc1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:12.817638 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-acb0aa1e-262c-48c0-9040-56beb8123342 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:12.818353 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-acb0aa1e-262c-48c0-9040-56beb8123342 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:12.824580 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-acb0aa1e-262c-48c0-9040-56beb8123342 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:12.825011 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-acb0aa1e-262c-48c0-9040-56beb8123342 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:12.825930 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-acb0aa1e-262c-48c0-9040-56beb8123342 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:12.826550 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-acb0aa1e-262c-48c0-9040-56beb8123342 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:12.900483 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-10a77c00-feca-40ff-a03c-f80c98404cc1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119926 Nov 23 14:31:12.900483 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 61/134] 10.222.0.82 () {58 vars in 1274 bytes} [Tue Nov 23 14:31:12 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:31:12.975295 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-acb0aa1e-262c-48c0-9040-56beb8123342 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:12.986091 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-acb0aa1e-262c-48c0-9040-56beb8123342 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:12.988344 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-acb0aa1e-262c-48c0-9040-56beb8123342 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:12.989946 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-acb0aa1e-262c-48c0-9040-56beb8123342 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1407 microversion: 2.20 time: 0.176148 Nov 23 14:31:12.991908 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 74/135] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:31:12 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:31:13.672275 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-eed68d81-f5f6-41f3-825e-7d97390c9db3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:13.672952 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-eed68d81-f5f6-41f3-825e-7d97390c9db3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:13.679165 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-eed68d81-f5f6-41f3-825e-7d97390c9db3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:13.679619 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-eed68d81-f5f6-41f3-825e-7d97390c9db3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:13.680434 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-eed68d81-f5f6-41f3-825e-7d97390c9db3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:13.680872 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-eed68d81-f5f6-41f3-825e-7d97390c9db3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:13.940028 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-eed68d81-f5f6-41f3-825e-7d97390c9db3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:13.947554 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-eed68d81-f5f6-41f3-825e-7d97390c9db3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.281030 Nov 23 14:31:13.948131 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 62/136] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:13 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:14.008888 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-2afdbfff-d8a2-4b5b-8376-20b14fcb9be6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:14.009487 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-2afdbfff-d8a2-4b5b-8376-20b14fcb9be6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:14.016388 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2afdbfff-d8a2-4b5b-8376-20b14fcb9be6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:14.016835 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2afdbfff-d8a2-4b5b-8376-20b14fcb9be6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:14.017608 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2afdbfff-d8a2-4b5b-8376-20b14fcb9be6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:14.018037 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2afdbfff-d8a2-4b5b-8376-20b14fcb9be6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:14.159662 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-2afdbfff-d8a2-4b5b-8376-20b14fcb9be6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:14.168755 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-2afdbfff-d8a2-4b5b-8376-20b14fcb9be6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:14.171913 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-2afdbfff-d8a2-4b5b-8376-20b14fcb9be6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:14.174089 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-2afdbfff-d8a2-4b5b-8376-20b14fcb9be6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1598 microversion: 2.20 time: 0.169136 Nov 23 14:31:14.175261 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 75/137] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:31:14 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:31:14.193487 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-551fe6f8-766e-4796-99f2-2f27fa9f9be1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:14.193975 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-551fe6f8-766e-4796-99f2-2f27fa9f9be1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:14.199971 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-551fe6f8-766e-4796-99f2-2f27fa9f9be1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:14.200459 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-551fe6f8-766e-4796-99f2-2f27fa9f9be1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:14.201424 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-551fe6f8-766e-4796-99f2-2f27fa9f9be1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:14.202077 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-551fe6f8-766e-4796-99f2-2f27fa9f9be1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:14.270991 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b7e0e2ea-ef06-4c50-b4e0-49ba8bdc26eb tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ae5c4e4-a880-4ca1-ac76-33b3e0c9b3fd"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:14.272230 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b7e0e2ea-ef06-4c50-b4e0-49ba8bdc26eb tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:14.278157 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b7e0e2ea-ef06-4c50-b4e0-49ba8bdc26eb tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:14.278680 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b7e0e2ea-ef06-4c50-b4e0-49ba8bdc26eb tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:14.279544 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b7e0e2ea-ef06-4c50-b4e0-49ba8bdc26eb tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:14.279983 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b7e0e2ea-ef06-4c50-b4e0-49ba8bdc26eb tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:14.296632 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-551fe6f8-766e-4796-99f2-2f27fa9f9be1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.106051 Nov 23 14:31:14.297376 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 63/138] 10.222.0.82 () {60 vars in 1315 bytes} [Tue Nov 23 14:31:14 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:31:14.969309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c522bcc8-1aaf-4a0d-86ac-5d91c24137a6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:14.980348 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c522bcc8-1aaf-4a0d-86ac-5d91c24137a6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:14.994295 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c522bcc8-1aaf-4a0d-86ac-5d91c24137a6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:14.994751 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c522bcc8-1aaf-4a0d-86ac-5d91c24137a6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:14.995553 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c522bcc8-1aaf-4a0d-86ac-5d91c24137a6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:14.995991 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c522bcc8-1aaf-4a0d-86ac-5d91c24137a6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:15.292055 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c522bcc8-1aaf-4a0d-86ac-5d91c24137a6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:15.300484 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c522bcc8-1aaf-4a0d-86ac-5d91c24137a6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.338562 Nov 23 14:31:15.301067 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 64/139] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:14 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:15.305689 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-de07c0d5-04d8-4e5a-bb76-030826f01572 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:15.306626 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-de07c0d5-04d8-4e5a-bb76-030826f01572 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:15.316528 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-de07c0d5-04d8-4e5a-bb76-030826f01572 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:15.316969 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-de07c0d5-04d8-4e5a-bb76-030826f01572 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:15.317840 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-de07c0d5-04d8-4e5a-bb76-030826f01572 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:15.318266 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-de07c0d5-04d8-4e5a-bb76-030826f01572 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:17.697433 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-de07c0d5-04d8-4e5a-bb76-030826f01572 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 14 microversion: 2.1 time: 2.394905 Nov 23 14:31:17.698103 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 65/140] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:15 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 14 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:31:17.703858 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-fb7d1937-bfb6-4b7a-a182-86eeed4267ba req-4d374763-bb16-4a01-a705-eb02de81907e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace5aa86-e88f-49e1-b497-966c499eba99", "tag": "ede71cd5-6bc1-4eed-a9a6-c4d4c9fe08fc"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:17.705380 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:31:17.705380 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:31:17.713628 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-fb7d1937-bfb6-4b7a-a182-86eeed4267ba req-4d374763-bb16-4a01-a705-eb02de81907e service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:17.714067 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-fb7d1937-bfb6-4b7a-a182-86eeed4267ba req-4d374763-bb16-4a01-a705-eb02de81907e service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:17.725619 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-fb7d1937-bfb6-4b7a-a182-86eeed4267ba req-4d374763-bb16-4a01-a705-eb02de81907e service nova] Creating event network-changed:ede71cd5-6bc1-4eed-a9a6-c4d4c9fe08fc for instance ace5aa86-e88f-49e1-b497-966c499eba99 on hv-cinder-80475 Nov 23 14:31:17.731440 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-fb7d1937-bfb6-4b7a-a182-86eeed4267ba req-4d374763-bb16-4a01-a705-eb02de81907e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031940 Nov 23 14:31:17.732157 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 66/141] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:31:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:31:17.738676 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-29a54bd4-0828-4830-adf3-c219890903e2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:17.739659 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-29a54bd4-0828-4830-adf3-c219890903e2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:17.763786 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-29a54bd4-0828-4830-adf3-c219890903e2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:17.764263 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-29a54bd4-0828-4830-adf3-c219890903e2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:17.765674 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-29a54bd4-0828-4830-adf3-c219890903e2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:17.766390 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-29a54bd4-0828-4830-adf3-c219890903e2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:17.831655 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-29a54bd4-0828-4830-adf3-c219890903e2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 14 microversion: 2.20 time: 0.098180 Nov 23 14:31:17.833208 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 67/142] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:17 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:17.839255 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6cb52ce5-bf75-4dbe-a8f1-8d7a541049a9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:17.840697 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6cb52ce5-bf75-4dbe-a8f1-8d7a541049a9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:17.853124 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6cb52ce5-bf75-4dbe-a8f1-8d7a541049a9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:17.853976 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6cb52ce5-bf75-4dbe-a8f1-8d7a541049a9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:17.855222 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6cb52ce5-bf75-4dbe-a8f1-8d7a541049a9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:17.855847 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6cb52ce5-bf75-4dbe-a8f1-8d7a541049a9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:18.219752 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6cb52ce5-bf75-4dbe-a8f1-8d7a541049a9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:18.219752 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6cb52ce5-bf75-4dbe-a8f1-8d7a541049a9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.367652 Nov 23 14:31:18.219752 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 68/143] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:17 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:18.689655 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b7e0e2ea-ef06-4c50-b4e0-49ba8bdc26eb tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "POST /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.422538 Nov 23 14:31:18.690906 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 76/144] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Nov 23 14:31:14 2021] POST /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b/os-volume_attachments => generated 194 bytes in 4425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:31:18.711979 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1ff4e494-7509-46ab-b766-e998b1cd6311 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:18.712942 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1ff4e494-7509-46ab-b766-e998b1cd6311 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:18.720278 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1ff4e494-7509-46ab-b766-e998b1cd6311 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:18.720721 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1ff4e494-7509-46ab-b766-e998b1cd6311 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:18.721498 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1ff4e494-7509-46ab-b766-e998b1cd6311 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:18.721931 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1ff4e494-7509-46ab-b766-e998b1cd6311 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:18.789265 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1ff4e494-7509-46ab-b766-e998b1cd6311 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 14 microversion: 2.1 time: 0.080639 Nov 23 14:31:18.789839 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 69/145] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:18 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:31:18.843895 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-42c4d48a-dd87-4d71-94b7-e918d729baaa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:18.845037 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-42c4d48a-dd87-4d71-94b7-e918d729baaa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:18.851715 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-42c4d48a-dd87-4d71-94b7-e918d729baaa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:18.852163 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-42c4d48a-dd87-4d71-94b7-e918d729baaa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:18.852966 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-42c4d48a-dd87-4d71-94b7-e918d729baaa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:18.853402 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-42c4d48a-dd87-4d71-94b7-e918d729baaa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:18.915947 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-42c4d48a-dd87-4d71-94b7-e918d729baaa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 14 microversion: 2.20 time: 0.075678 Nov 23 14:31:18.915947 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 77/146] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:18 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:19.223935 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-25e81c60-ad13-4501-8c1e-417a7995cac4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:19.224707 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-25e81c60-ad13-4501-8c1e-417a7995cac4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:19.232569 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-25e81c60-ad13-4501-8c1e-417a7995cac4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:19.238193 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-25e81c60-ad13-4501-8c1e-417a7995cac4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:19.238193 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-25e81c60-ad13-4501-8c1e-417a7995cac4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:19.238193 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-25e81c60-ad13-4501-8c1e-417a7995cac4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:19.396289 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-25e81c60-ad13-4501-8c1e-417a7995cac4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:19.404154 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-25e81c60-ad13-4501-8c1e-417a7995cac4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.184459 Nov 23 14:31:19.404747 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 70/147] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:19 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:19.749427 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-9ea8c94a-731a-48d3-9d29-89543af784d3 req-6b13eae4-57b7-4839-81a2-eaab56dd4477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c8dbd0-2f80-4158-923b-24f263fd9832", "tag": "643c4469-7e07-47b2-806d-0dfc74abe378"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:19.751080 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:31:19.751080 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:31:19.758801 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-9ea8c94a-731a-48d3-9d29-89543af784d3 req-6b13eae4-57b7-4839-81a2-eaab56dd4477 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:19.759242 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-9ea8c94a-731a-48d3-9d29-89543af784d3 req-6b13eae4-57b7-4839-81a2-eaab56dd4477 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:19.771075 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-9ea8c94a-731a-48d3-9d29-89543af784d3 req-6b13eae4-57b7-4839-81a2-eaab56dd4477 service nova] Creating event network-changed:643c4469-7e07-47b2-806d-0dfc74abe378 for instance f5c8dbd0-2f80-4158-923b-24f263fd9832 on hv-cinder-80475 Nov 23 14:31:19.775876 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-9ea8c94a-731a-48d3-9d29-89543af784d3 req-6b13eae4-57b7-4839-81a2-eaab56dd4477 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030430 Nov 23 14:31:19.776507 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 78/148] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:31:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:31:19.799310 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-00499d0c-9793-48ff-abf4-2bc9a1aa91ad tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:19.801430 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-00499d0c-9793-48ff-abf4-2bc9a1aa91ad tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:19.806497 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-00499d0c-9793-48ff-abf4-2bc9a1aa91ad tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:19.806940 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-00499d0c-9793-48ff-abf4-2bc9a1aa91ad tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:19.807747 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-00499d0c-9793-48ff-abf4-2bc9a1aa91ad tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:19.808186 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-00499d0c-9793-48ff-abf4-2bc9a1aa91ad tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:19.896457 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-00499d0c-9793-48ff-abf4-2bc9a1aa91ad tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 14 microversion: 2.1 time: 0.100940 Nov 23 14:31:19.897199 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 71/149] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:19 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:31:19.926839 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6a01bd5a-b451-41ba-b878-b1879d5802aa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:19.927935 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6a01bd5a-b451-41ba-b878-b1879d5802aa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:19.935232 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6a01bd5a-b451-41ba-b878-b1879d5802aa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:19.935674 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6a01bd5a-b451-41ba-b878-b1879d5802aa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:19.936667 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6a01bd5a-b451-41ba-b878-b1879d5802aa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:19.937088 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6a01bd5a-b451-41ba-b878-b1879d5802aa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:20.013317 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6a01bd5a-b451-41ba-b878-b1879d5802aa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 14 microversion: 2.20 time: 0.091266 Nov 23 14:31:20.013948 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 79/150] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:19 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:20.323653 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2d234c4b-b007-4005-a079-719d9d82782e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-682788722", "imageRef": "b06b9241-c147-436d-86bb-7c49ad8ef09c", "flavorRef": "452", "networks": [{"uuid": "27ebbb4f-c920-416e-88ae-b0ddbdad523e"}]}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:20.377065 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.network.neutron [None req-2d234c4b-b007-4005-a079-719d9d82782e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] validate_networks() for [('27ebbb4f-c920-416e-88ae-b0ddbdad523e', None, None, None, None, None)] {{(pid=116787) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:31:20.422942 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d9a370b0-eed3-4e06-808e-39503861922d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:20.423603 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d9a370b0-eed3-4e06-808e-39503861922d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:20.430377 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d9a370b0-eed3-4e06-808e-39503861922d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:20.434564 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d9a370b0-eed3-4e06-808e-39503861922d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:20.434564 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d9a370b0-eed3-4e06-808e-39503861922d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:20.434564 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d9a370b0-eed3-4e06-808e-39503861922d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:20.583917 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d9a370b0-eed3-4e06-808e-39503861922d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:20.591355 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d9a370b0-eed3-4e06-808e-39503861922d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.172899 Nov 23 14:31:20.591931 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 80/151] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:20 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:20.729001 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-2d234c4b-b007-4005-a079-719d9d82782e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Flavor limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:31:20.729425 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-2d234c4b-b007-4005-a079-719d9d82782e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Image limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:31:20.729900 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-2d234c4b-b007-4005-a079-719d9d82782e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Flavor pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:31:20.730309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-2d234c4b-b007-4005-a079-719d9d82782e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Image pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:31:20.730722 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-2d234c4b-b007-4005-a079-719d9d82782e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:31:20.739435 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2d234c4b-b007-4005-a079-719d9d82782e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:20.742466 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2d234c4b-b007-4005-a079-719d9d82782e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:20.742466 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2d234c4b-b007-4005-a079-719d9d82782e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:20.742466 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2d234c4b-b007-4005-a079-719d9d82782e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:20.758843 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-2d234c4b-b007-4005-a079-719d9d82782e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Getting quotas for project 2ebe2cb2394a4a3199c5df49b8793c0d. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:31:20.762850 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-2d234c4b-b007-4005-a079-719d9d82782e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Getting quotas for user 3d07bdc2fc3343af84a3899c2ad7302b and project 2ebe2cb2394a4a3199c5df49b8793c0d. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:31:20.777460 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2d234c4b-b007-4005-a079-719d9d82782e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Going to run 1 instances... {{(pid=116787) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:31:20.779937 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2d234c4b-b007-4005-a079-719d9d82782e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b06b9241-c147-436d-86bb-7c49ad8ef09c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:31:20.907002 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-40f1116d-e3e8-4b21-8cd1-1f07bc22e57e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:20.908169 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-40f1116d-e3e8-4b21-8cd1-1f07bc22e57e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:20.916210 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-40f1116d-e3e8-4b21-8cd1-1f07bc22e57e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:20.916210 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-40f1116d-e3e8-4b21-8cd1-1f07bc22e57e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:20.916210 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-40f1116d-e3e8-4b21-8cd1-1f07bc22e57e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:20.916666 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-40f1116d-e3e8-4b21-8cd1-1f07bc22e57e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:20.927258 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2d234c4b-b007-4005-a079-719d9d82782e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617642 Nov 23 14:31:20.927902 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 72/152] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:31:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 14:31:20.939211 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9252d2a6-7e7b-494c-aaf2-0f96cd4f61a6 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:20.940041 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9252d2a6-7e7b-494c-aaf2-0f96cd4f61a6 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:20.995582 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-40f1116d-e3e8-4b21-8cd1-1f07bc22e57e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 14 microversion: 2.1 time: 0.092085 Nov 23 14:31:20.999180 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 81/153] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:20 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 14:31:20.999530 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9252d2a6-7e7b-494c-aaf2-0f96cd4f61a6 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:21.007874 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9252d2a6-7e7b-494c-aaf2-0f96cd4f61a6 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1213 microversion: 2.1 time: 0.073824 Nov 23 14:31:21.008475 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 73/154] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:20 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:21.025366 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c9f46cc7-2da3-498f-8370-eca6c13a6875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:21.026351 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c9f46cc7-2da3-498f-8370-eca6c13a6875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:21.037796 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c9f46cc7-2da3-498f-8370-eca6c13a6875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:21.038250 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c9f46cc7-2da3-498f-8370-eca6c13a6875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:21.040901 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c9f46cc7-2da3-498f-8370-eca6c13a6875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:21.041552 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c9f46cc7-2da3-498f-8370-eca6c13a6875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:21.128747 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c9f46cc7-2da3-498f-8370-eca6c13a6875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 14 microversion: 2.20 time: 0.107587 Nov 23 14:31:21.129453 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 82/155] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:21 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:21.610101 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a484ae96-1955-4bfb-9d4c-6e5b10185d43 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:21.610531 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a484ae96-1955-4bfb-9d4c-6e5b10185d43 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:21.617772 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a484ae96-1955-4bfb-9d4c-6e5b10185d43 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:21.618253 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a484ae96-1955-4bfb-9d4c-6e5b10185d43 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:21.619113 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a484ae96-1955-4bfb-9d4c-6e5b10185d43 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:21.619553 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a484ae96-1955-4bfb-9d4c-6e5b10185d43 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:21.832746 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a484ae96-1955-4bfb-9d4c-6e5b10185d43 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:21.842186 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a484ae96-1955-4bfb-9d4c-6e5b10185d43 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.236358 Nov 23 14:31:21.843524 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 74/156] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:21 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:22.007565 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f2251285-55f9-4eda-b97a-404e13685e8c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:22.009458 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f2251285-55f9-4eda-b97a-404e13685e8c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:22.017729 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f2251285-55f9-4eda-b97a-404e13685e8c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:22.018177 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f2251285-55f9-4eda-b97a-404e13685e8c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:22.019002 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f2251285-55f9-4eda-b97a-404e13685e8c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:22.019602 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f2251285-55f9-4eda-b97a-404e13685e8c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:22.025264 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8b1ffdc6-b4ec-415a-a1ec-2c9c1d067add tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:22.026492 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8b1ffdc6-b4ec-415a-a1ec-2c9c1d067add tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:22.040286 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8b1ffdc6-b4ec-415a-a1ec-2c9c1d067add tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:22.040286 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8b1ffdc6-b4ec-415a-a1ec-2c9c1d067add tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:22.040286 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8b1ffdc6-b4ec-415a-a1ec-2c9c1d067add tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:22.040784 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8b1ffdc6-b4ec-415a-a1ec-2c9c1d067add tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:22.141620 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f2251285-55f9-4eda-b97a-404e13685e8c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 14 microversion: 2.1 time: 0.137489 Nov 23 14:31:22.145415 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 83/157] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:22 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:31:22.148282 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-19130083-ff03-4d2b-8d9e-d0fdf7336314 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:22.149352 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-19130083-ff03-4d2b-8d9e-d0fdf7336314 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:22.159563 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-19130083-ff03-4d2b-8d9e-d0fdf7336314 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:22.160036 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-19130083-ff03-4d2b-8d9e-d0fdf7336314 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:22.160890 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-19130083-ff03-4d2b-8d9e-d0fdf7336314 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:22.161890 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-19130083-ff03-4d2b-8d9e-d0fdf7336314 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:22.162955 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-8b1ffdc6-b4ec-415a-a1ec-2c9c1d067add tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:22.173756 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8b1ffdc6-b4ec-415a-a1ec-2c9c1d067add tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1217 microversion: 2.1 time: 0.152255 Nov 23 14:31:22.174787 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 75/158] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:22 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:22.250867 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-19130083-ff03-4d2b-8d9e-d0fdf7336314 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 14 microversion: 2.20 time: 0.105865 Nov 23 14:31:22.251488 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 84/159] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:22 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:22.860374 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0d09bdb6-77b5-4915-bd94-89caf9d74e99 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:22.861004 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0d09bdb6-77b5-4915-bd94-89caf9d74e99 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:22.867544 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0d09bdb6-77b5-4915-bd94-89caf9d74e99 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:22.867989 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0d09bdb6-77b5-4915-bd94-89caf9d74e99 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:22.868789 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0d09bdb6-77b5-4915-bd94-89caf9d74e99 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:22.869214 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0d09bdb6-77b5-4915-bd94-89caf9d74e99 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:23.018134 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0d09bdb6-77b5-4915-bd94-89caf9d74e99 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:23.025608 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0d09bdb6-77b5-4915-bd94-89caf9d74e99 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.169581 Nov 23 14:31:23.026165 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 76/160] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:22 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:23.152806 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3aab06af-b8e3-45e7-ace5-f4c9315856ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:23.153712 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3aab06af-b8e3-45e7-ace5-f4c9315856ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:23.160888 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3aab06af-b8e3-45e7-ace5-f4c9315856ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:23.161333 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3aab06af-b8e3-45e7-ace5-f4c9315856ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:23.162099 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3aab06af-b8e3-45e7-ace5-f4c9315856ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:23.162533 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3aab06af-b8e3-45e7-ace5-f4c9315856ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:23.192436 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d18a186f-31e4-4dce-8edb-5a86be4d8a07 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:23.193137 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d18a186f-31e4-4dce-8edb-5a86be4d8a07 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:23.199029 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d18a186f-31e4-4dce-8edb-5a86be4d8a07 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:23.199466 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d18a186f-31e4-4dce-8edb-5a86be4d8a07 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:23.200309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d18a186f-31e4-4dce-8edb-5a86be4d8a07 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:23.200710 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d18a186f-31e4-4dce-8edb-5a86be4d8a07 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:23.242117 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3aab06af-b8e3-45e7-ace5-f4c9315856ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 14 microversion: 2.1 time: 0.092287 Nov 23 14:31:23.244339 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 85/161] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:23 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:31:23.268108 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c26b2f9f-16b0-49d1-bfac-a5844584e3b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:23.269208 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c26b2f9f-16b0-49d1-bfac-a5844584e3b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:23.277100 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c26b2f9f-16b0-49d1-bfac-a5844584e3b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:23.278038 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c26b2f9f-16b0-49d1-bfac-a5844584e3b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:23.279773 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c26b2f9f-16b0-49d1-bfac-a5844584e3b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:23.280767 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c26b2f9f-16b0-49d1-bfac-a5844584e3b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:23.281353 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d18a186f-31e4-4dce-8edb-5a86be4d8a07 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:23.289217 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d18a186f-31e4-4dce-8edb-5a86be4d8a07 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1265 microversion: 2.1 time: 0.101830 Nov 23 14:31:23.299948 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 77/162] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:23 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:23.354101 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c26b2f9f-16b0-49d1-bfac-a5844584e3b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 14 microversion: 2.20 time: 0.095210 Nov 23 14:31:23.354882 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 86/163] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:23 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:24.042483 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-76bb703d-d72f-47c9-a9ca-a2fbd3178528 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:24.043204 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-76bb703d-d72f-47c9-a9ca-a2fbd3178528 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:24.049964 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-76bb703d-d72f-47c9-a9ca-a2fbd3178528 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:24.050491 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-76bb703d-d72f-47c9-a9ca-a2fbd3178528 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:24.051332 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-76bb703d-d72f-47c9-a9ca-a2fbd3178528 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:24.051763 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-76bb703d-d72f-47c9-a9ca-a2fbd3178528 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:24.254239 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-4916c7fe-adaa-40ff-931e-26fbf5fa5cc2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:24.255839 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-4916c7fe-adaa-40ff-931e-26fbf5fa5cc2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:24.256118 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-76bb703d-d72f-47c9-a9ca-a2fbd3178528 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:24.263620 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4916c7fe-adaa-40ff-931e-26fbf5fa5cc2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:24.264467 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4916c7fe-adaa-40ff-931e-26fbf5fa5cc2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:24.266115 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4916c7fe-adaa-40ff-931e-26fbf5fa5cc2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:24.266400 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-76bb703d-d72f-47c9-a9ca-a2fbd3178528 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.226226 Nov 23 14:31:24.275964 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 78/164] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:24 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:24.277828 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4916c7fe-adaa-40ff-931e-26fbf5fa5cc2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:24.308159 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e4900f52-8c3e-47cf-9eca-514f95835e38 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:24.308802 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e4900f52-8c3e-47cf-9eca-514f95835e38 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:24.321378 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e4900f52-8c3e-47cf-9eca-514f95835e38 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:24.321827 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e4900f52-8c3e-47cf-9eca-514f95835e38 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:24.323553 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e4900f52-8c3e-47cf-9eca-514f95835e38 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:24.323553 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e4900f52-8c3e-47cf-9eca-514f95835e38 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:24.378489 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-4916c7fe-adaa-40ff-931e-26fbf5fa5cc2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 14 microversion: 2.1 time: 0.128250 Nov 23 14:31:24.384574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 87/165] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:24 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 14:31:24.389836 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-20710a2c-65b8-4f00-8e77-66da7e7adb91 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:24.390858 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-20710a2c-65b8-4f00-8e77-66da7e7adb91 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:24.398138 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-20710a2c-65b8-4f00-8e77-66da7e7adb91 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:24.398805 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-20710a2c-65b8-4f00-8e77-66da7e7adb91 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:24.399765 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-20710a2c-65b8-4f00-8e77-66da7e7adb91 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:24.400412 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-20710a2c-65b8-4f00-8e77-66da7e7adb91 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:24.413164 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e4900f52-8c3e-47cf-9eca-514f95835e38 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:24.422858 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e4900f52-8c3e-47cf-9eca-514f95835e38 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1271 microversion: 2.1 time: 0.118698 Nov 23 14:31:24.424369 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 79/166] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:24 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:24.497100 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-20710a2c-65b8-4f00-8e77-66da7e7adb91 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 14 microversion: 2.20 time: 0.110214 Nov 23 14:31:24.501584 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 88/167] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:24 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:25.285431 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2f909202-c1b5-49a3-9687-b110788cde42 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:25.286752 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2f909202-c1b5-49a3-9687-b110788cde42 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:25.294481 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2f909202-c1b5-49a3-9687-b110788cde42 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:25.294922 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2f909202-c1b5-49a3-9687-b110788cde42 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:25.295696 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2f909202-c1b5-49a3-9687-b110788cde42 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:25.296179 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2f909202-c1b5-49a3-9687-b110788cde42 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:25.390712 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9938053b-0733-4217-994e-37f116ce01ea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:25.393166 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9938053b-0733-4217-994e-37f116ce01ea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:25.404058 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9938053b-0733-4217-994e-37f116ce01ea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:25.404673 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9938053b-0733-4217-994e-37f116ce01ea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:25.405452 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9938053b-0733-4217-994e-37f116ce01ea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:25.406701 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9938053b-0733-4217-994e-37f116ce01ea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:25.483494 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9938053b-0733-4217-994e-37f116ce01ea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 14 microversion: 2.1 time: 0.096895 Nov 23 14:31:25.484709 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 89/168] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:25 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:31:25.489939 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-8835c6b2-f109-42c9-9003-67e260830ecd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:25.490664 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-8835c6b2-f109-42c9-9003-67e260830ecd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:25.497148 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8835c6b2-f109-42c9-9003-67e260830ecd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:25.497587 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8835c6b2-f109-42c9-9003-67e260830ecd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:25.498522 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8835c6b2-f109-42c9-9003-67e260830ecd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:25.498946 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8835c6b2-f109-42c9-9003-67e260830ecd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:25.528471 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2f909202-c1b5-49a3-9687-b110788cde42 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:25.552082 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2f909202-c1b5-49a3-9687-b110788cde42 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.269973 Nov 23 14:31:25.564451 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 80/169] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:25 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:25.579723 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2efe6dcd-62a0-40a2-96ba-25dcff2d8d38 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:25.583037 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2efe6dcd-62a0-40a2-96ba-25dcff2d8d38 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:25.597383 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2efe6dcd-62a0-40a2-96ba-25dcff2d8d38 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:25.597383 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2efe6dcd-62a0-40a2-96ba-25dcff2d8d38 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:25.601298 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2efe6dcd-62a0-40a2-96ba-25dcff2d8d38 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:25.602981 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2efe6dcd-62a0-40a2-96ba-25dcff2d8d38 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:25.656314 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-8835c6b2-f109-42c9-9003-67e260830ecd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:25.665565 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-8835c6b2-f109-42c9-9003-67e260830ecd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1313 microversion: 2.1 time: 0.179297 Nov 23 14:31:25.666140 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 90/170] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:25 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:25.697775 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2efe6dcd-62a0-40a2-96ba-25dcff2d8d38 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 14 microversion: 2.20 time: 0.130723 Nov 23 14:31:25.698451 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 81/171] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:25 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:25.837715 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-a42266c2-2873-431c-a6fb-b5dfbb76ed2c req-db817aaf-4b3e-4670-ae03-1d1a352c05db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c149ec46-47c0-4d43-abc6-ee2c901ab9b2", "tag": "0a48ea27-4a0b-401b-90ef-02b2cb56e046"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:25.839262 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:31:25.839262 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:31:25.851264 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-a42266c2-2873-431c-a6fb-b5dfbb76ed2c req-db817aaf-4b3e-4670-ae03-1d1a352c05db service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:25.851746 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-a42266c2-2873-431c-a6fb-b5dfbb76ed2c req-db817aaf-4b3e-4670-ae03-1d1a352c05db service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:25.879009 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-a42266c2-2873-431c-a6fb-b5dfbb76ed2c req-db817aaf-4b3e-4670-ae03-1d1a352c05db service nova] Creating event network-changed:0a48ea27-4a0b-401b-90ef-02b2cb56e046 for instance c149ec46-47c0-4d43-abc6-ee2c901ab9b2 on hv-cinder-80475 Nov 23 14:31:25.879009 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-a42266c2-2873-431c-a6fb-b5dfbb76ed2c req-db817aaf-4b3e-4670-ae03-1d1a352c05db service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035412 Nov 23 14:31:25.879009 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 91/172] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:31:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:31:26.496060 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6118184c-3d9a-4f8f-883a-a1e79717f375 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:26.497250 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6118184c-3d9a-4f8f-883a-a1e79717f375 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:26.505269 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6118184c-3d9a-4f8f-883a-a1e79717f375 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:26.506312 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6118184c-3d9a-4f8f-883a-a1e79717f375 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:26.507323 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6118184c-3d9a-4f8f-883a-a1e79717f375 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:26.507827 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6118184c-3d9a-4f8f-883a-a1e79717f375 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:26.572455 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f0e481da-f97a-4a24-a039-5b89978dfd73 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:26.573909 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f0e481da-f97a-4a24-a039-5b89978dfd73 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:26.584454 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f0e481da-f97a-4a24-a039-5b89978dfd73 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:26.585143 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f0e481da-f97a-4a24-a039-5b89978dfd73 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:26.586115 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f0e481da-f97a-4a24-a039-5b89978dfd73 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:26.587306 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f0e481da-f97a-4a24-a039-5b89978dfd73 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:26.592117 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6118184c-3d9a-4f8f-883a-a1e79717f375 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 14 microversion: 2.1 time: 0.100384 Nov 23 14:31:26.595593 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 82/173] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:26 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:31:26.684693 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b46edf71-3b5a-4a98-9875-b128f8dc164a tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:26.685559 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b46edf71-3b5a-4a98-9875-b128f8dc164a tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:26.704511 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b46edf71-3b5a-4a98-9875-b128f8dc164a tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:26.706472 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b46edf71-3b5a-4a98-9875-b128f8dc164a tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:26.707591 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b46edf71-3b5a-4a98-9875-b128f8dc164a tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:26.710490 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b46edf71-3b5a-4a98-9875-b128f8dc164a tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:26.807110 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-f0e481da-f97a-4a24-a039-5b89978dfd73 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:26.814759 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f0e481da-f97a-4a24-a039-5b89978dfd73 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.248035 Nov 23 14:31:26.824776 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 92/174] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:26 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:26.829676 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e546282a-48fe-41d5-a1fe-754f1b561f39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:26.830622 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e546282a-48fe-41d5-a1fe-754f1b561f39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:26.836542 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e546282a-48fe-41d5-a1fe-754f1b561f39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:26.836923 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e546282a-48fe-41d5-a1fe-754f1b561f39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:26.837721 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e546282a-48fe-41d5-a1fe-754f1b561f39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:26.838144 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e546282a-48fe-41d5-a1fe-754f1b561f39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:26.895361 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-b46edf71-3b5a-4a98-9875-b128f8dc164a tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:26.902921 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b46edf71-3b5a-4a98-9875-b128f8dc164a tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1313 microversion: 2.1 time: 0.223416 Nov 23 14:31:26.908739 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 83/175] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:26 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:26.981791 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e546282a-48fe-41d5-a1fe-754f1b561f39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 14 microversion: 2.20 time: 0.155606 Nov 23 14:31:26.982501 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 93/176] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:26 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:27.605462 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b44b610f-d731-4f70-872b-6cfff6a69df1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:27.606559 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b44b610f-d731-4f70-872b-6cfff6a69df1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:27.613187 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b44b610f-d731-4f70-872b-6cfff6a69df1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:27.613973 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b44b610f-d731-4f70-872b-6cfff6a69df1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:27.614644 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b44b610f-d731-4f70-872b-6cfff6a69df1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:27.615089 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b44b610f-d731-4f70-872b-6cfff6a69df1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:27.754523 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b44b610f-d731-4f70-872b-6cfff6a69df1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 6520 microversion: 2.1 time: 0.152640 Nov 23 14:31:27.755979 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 84/177] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:27 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 6520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:27.833517 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-68cddd61-592f-4f85-8c6b-0b4b4e1e2bc2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:27.834489 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-68cddd61-592f-4f85-8c6b-0b4b4e1e2bc2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:27.841194 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-68cddd61-592f-4f85-8c6b-0b4b4e1e2bc2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:27.841635 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-68cddd61-592f-4f85-8c6b-0b4b4e1e2bc2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:27.842400 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-68cddd61-592f-4f85-8c6b-0b4b4e1e2bc2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:27.842828 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-68cddd61-592f-4f85-8c6b-0b4b4e1e2bc2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:27.926057 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f49e63f7-a823-40fa-bca1-17dd1c13af4c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:27.926925 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f49e63f7-a823-40fa-bca1-17dd1c13af4c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:27.935189 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f49e63f7-a823-40fa-bca1-17dd1c13af4c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:27.935854 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f49e63f7-a823-40fa-bca1-17dd1c13af4c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:27.940642 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f49e63f7-a823-40fa-bca1-17dd1c13af4c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:27.940642 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f49e63f7-a823-40fa-bca1-17dd1c13af4c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:28.001434 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-68cddd61-592f-4f85-8c6b-0b4b4e1e2bc2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:28.010279 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-68cddd61-592f-4f85-8c6b-0b4b4e1e2bc2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.181674 Nov 23 14:31:28.011143 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 94/178] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:27 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:28.017002 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-cd731de0-a85d-43ad-9d31-eb3614be4a99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:28.018156 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-cd731de0-a85d-43ad-9d31-eb3614be4a99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:28.024603 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cd731de0-a85d-43ad-9d31-eb3614be4a99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:28.025372 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cd731de0-a85d-43ad-9d31-eb3614be4a99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:28.026291 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cd731de0-a85d-43ad-9d31-eb3614be4a99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:28.026882 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cd731de0-a85d-43ad-9d31-eb3614be4a99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:28.103112 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f49e63f7-a823-40fa-bca1-17dd1c13af4c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:28.110864 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f49e63f7-a823-40fa-bca1-17dd1c13af4c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1313 microversion: 2.1 time: 0.189826 Nov 23 14:31:28.111427 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 85/179] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:27 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:28.148861 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-cd731de0-a85d-43ad-9d31-eb3614be4a99 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 14 microversion: 2.20 time: 0.136309 Nov 23 14:31:28.149646 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 95/180] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:28 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:28.774322 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6901efa3-fbe4-4d3b-a02c-4771bd6f0a93 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:28.775231 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6901efa3-fbe4-4d3b-a02c-4771bd6f0a93 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:28.782416 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6901efa3-fbe4-4d3b-a02c-4771bd6f0a93 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:28.783269 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6901efa3-fbe4-4d3b-a02c-4771bd6f0a93 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:28.784050 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6901efa3-fbe4-4d3b-a02c-4771bd6f0a93 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:28.784505 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6901efa3-fbe4-4d3b-a02c-4771bd6f0a93 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:28.863734 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-770437ef-d49e-4826-bc48-fbb591fc0453 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1185156681", "imageRef": "b06b9241-c147-436d-86bb-7c49ad8ef09c", "flavorRef": "452"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:28.869981 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6901efa3-fbe4-4d3b-a02c-4771bd6f0a93 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 10893 microversion: 2.1 time: 0.099360 Nov 23 14:31:28.873954 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 86/181] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:28 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 10893 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:31:28.931995 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.network.neutron [None req-770437ef-d49e-4826-bc48-fbb591fc0453 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] validate_networks() for None {{(pid=116788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:31:29.028175 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c95413bd-f0cf-4a6d-90fc-4f79da8a452a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:29.029093 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c95413bd-f0cf-4a6d-90fc-4f79da8a452a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:29.036985 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c95413bd-f0cf-4a6d-90fc-4f79da8a452a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:29.037556 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c95413bd-f0cf-4a6d-90fc-4f79da8a452a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:29.038718 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c95413bd-f0cf-4a6d-90fc-4f79da8a452a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:29.039563 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c95413bd-f0cf-4a6d-90fc-4f79da8a452a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:29.209186 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c95413bd-f0cf-4a6d-90fc-4f79da8a452a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:29.216614 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c95413bd-f0cf-4a6d-90fc-4f79da8a452a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.192273 Nov 23 14:31:29.217796 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 87/182] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:29 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:29.222697 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-28a96945-f193-4d99-83ea-bfa3b5fccd4e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:29.223305 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-28a96945-f193-4d99-83ea-bfa3b5fccd4e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:29.229892 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-28a96945-f193-4d99-83ea-bfa3b5fccd4e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:29.230395 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-28a96945-f193-4d99-83ea-bfa3b5fccd4e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:29.231231 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-28a96945-f193-4d99-83ea-bfa3b5fccd4e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:29.231662 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-28a96945-f193-4d99-83ea-bfa3b5fccd4e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:29.305568 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-770437ef-d49e-4826-bc48-fbb591fc0453 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Flavor limits 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:31:29.305988 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-770437ef-d49e-4826-bc48-fbb591fc0453 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Image limits 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:31:29.306456 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-770437ef-d49e-4826-bc48-fbb591fc0453 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Flavor pref 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:31:29.306861 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-770437ef-d49e-4826-bc48-fbb591fc0453 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Image pref 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:31:29.307266 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-770437ef-d49e-4826-bc48-fbb591fc0453 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:31:29.319408 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-770437ef-d49e-4826-bc48-fbb591fc0453 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:29.319942 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-770437ef-d49e-4826-bc48-fbb591fc0453 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:29.323860 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-770437ef-d49e-4826-bc48-fbb591fc0453 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:29.323860 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-770437ef-d49e-4826-bc48-fbb591fc0453 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:29.339816 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-770437ef-d49e-4826-bc48-fbb591fc0453 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Getting quotas for project a4719be271ae49a18146758f634bfe77. Resources: {'instances', 'cores', 'ram'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:31:29.345002 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-770437ef-d49e-4826-bc48-fbb591fc0453 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Getting quotas for user 7309bf14fa08466a9ebb24f25836b235 and project a4719be271ae49a18146758f634bfe77. Resources: {'instances', 'cores', 'ram'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:31:29.356733 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-770437ef-d49e-4826-bc48-fbb591fc0453 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Going to run 1 instances... {{(pid=116788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:31:29.359717 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-770437ef-d49e-4826-bc48-fbb591fc0453 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b06b9241-c147-436d-86bb-7c49ad8ef09c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:31:29.386316 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-28a96945-f193-4d99-83ea-bfa3b5fccd4e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:29.394897 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-28a96945-f193-4d99-83ea-bfa3b5fccd4e tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1313 microversion: 2.1 time: 0.175992 Nov 23 14:31:29.395466 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 88/183] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:29 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:29.409523 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a1a2d5de-7fae-4e9f-b5eb-7854e8e8d306 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:29.411942 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a1a2d5de-7fae-4e9f-b5eb-7854e8e8d306 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:29.417581 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a1a2d5de-7fae-4e9f-b5eb-7854e8e8d306 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:29.418141 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a1a2d5de-7fae-4e9f-b5eb-7854e8e8d306 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:29.418983 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a1a2d5de-7fae-4e9f-b5eb-7854e8e8d306 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:29.419529 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a1a2d5de-7fae-4e9f-b5eb-7854e8e8d306 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:29.498148 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a1a2d5de-7fae-4e9f-b5eb-7854e8e8d306 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 14 microversion: 2.20 time: 0.092934 Nov 23 14:31:29.501983 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 89/184] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:29 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:29.537957 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-770437ef-d49e-4826-bc48-fbb591fc0453 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679764 Nov 23 14:31:29.543646 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 96/185] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:31:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 14:31:29.550803 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e685642b-8d87-417f-8ed0-2924964a5f17 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:29.551498 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e685642b-8d87-417f-8ed0-2924964a5f17 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:29.623898 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e685642b-8d87-417f-8ed0-2924964a5f17 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:29.631941 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e685642b-8d87-417f-8ed0-2924964a5f17 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1215 microversion: 2.1 time: 0.085359 Nov 23 14:31:29.632540 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 90/186] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:29 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:29.882172 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9068513c-f574-4a73-97a1-83363643fd6b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:29.883161 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9068513c-f574-4a73-97a1-83363643fd6b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:29.890008 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9068513c-f574-4a73-97a1-83363643fd6b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:29.891140 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9068513c-f574-4a73-97a1-83363643fd6b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:29.893090 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9068513c-f574-4a73-97a1-83363643fd6b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:29.893265 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9068513c-f574-4a73-97a1-83363643fd6b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:29.955930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c35c5c22-9b4e-491b-8c47-ba1665426566 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:29.956606 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c35c5c22-9b4e-491b-8c47-ba1665426566 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:29.963162 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c35c5c22-9b4e-491b-8c47-ba1665426566 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:29.963608 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c35c5c22-9b4e-491b-8c47-ba1665426566 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:29.964465 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c35c5c22-9b4e-491b-8c47-ba1665426566 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:29.964827 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c35c5c22-9b4e-491b-8c47-ba1665426566 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:29.973923 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9068513c-f574-4a73-97a1-83363643fd6b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 15064 microversion: 2.1 time: 0.095502 Nov 23 14:31:29.977892 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 97/187] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:29 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 15064 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:31:29.992254 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c35c5c22-9b4e-491b-8c47-ba1665426566 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Going to try to terminate instance {{(pid=116787) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:31:30.233928 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3d13b347-a8be-4de0-a140-895fcbd05f28 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:30.235282 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3d13b347-a8be-4de0-a140-895fcbd05f28 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:30.242363 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3d13b347-a8be-4de0-a140-895fcbd05f28 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:30.242805 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3d13b347-a8be-4de0-a140-895fcbd05f28 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:30.243581 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3d13b347-a8be-4de0-a140-895fcbd05f28 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:30.244013 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3d13b347-a8be-4de0-a140-895fcbd05f28 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:30.325206 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c35c5c22-9b4e-491b-8c47-ba1665426566 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "DELETE /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 204 len: 0 microversion: 2.1 time: 0.373364 Nov 23 14:31:30.328019 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 91/188] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:31:29 2021] DELETE /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 14:31:30.334279 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5f2081bd-1943-4aea-86f4-16a16dddfb73 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:30.335416 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5f2081bd-1943-4aea-86f4-16a16dddfb73 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:30.341782 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5f2081bd-1943-4aea-86f4-16a16dddfb73 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:30.342236 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5f2081bd-1943-4aea-86f4-16a16dddfb73 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:30.343045 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5f2081bd-1943-4aea-86f4-16a16dddfb73 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:30.343478 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5f2081bd-1943-4aea-86f4-16a16dddfb73 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:30.407364 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-3d13b347-a8be-4de0-a140-895fcbd05f28 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:30.414994 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3d13b347-a8be-4de0-a140-895fcbd05f28 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.184961 Nov 23 14:31:30.415645 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 98/189] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:30 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:30.420298 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-2e44800a-0769-4c27-83c5-982c0af0f9d5 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:30.421105 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-2e44800a-0769-4c27-83c5-982c0af0f9d5 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:30.426741 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2e44800a-0769-4c27-83c5-982c0af0f9d5 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:30.427187 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2e44800a-0769-4c27-83c5-982c0af0f9d5 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:30.427956 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2e44800a-0769-4c27-83c5-982c0af0f9d5 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:30.431460 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2e44800a-0769-4c27-83c5-982c0af0f9d5 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:30.503403 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5f2081bd-1943-4aea-86f4-16a16dddfb73 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:30.512027 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5f2081bd-1943-4aea-86f4-16a16dddfb73 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1554 microversion: 2.1 time: 0.181863 Nov 23 14:31:30.512636 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 92/190] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:30 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:30.518450 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ab864f2b-5870-4cd5-98fe-5c269b415ef6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:30.519588 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ab864f2b-5870-4cd5-98fe-5c269b415ef6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:30.527517 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ab864f2b-5870-4cd5-98fe-5c269b415ef6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:30.528197 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ab864f2b-5870-4cd5-98fe-5c269b415ef6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:30.529025 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ab864f2b-5870-4cd5-98fe-5c269b415ef6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:30.529452 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ab864f2b-5870-4cd5-98fe-5c269b415ef6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:30.574133 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-2e44800a-0769-4c27-83c5-982c0af0f9d5 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:30.582839 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-2e44800a-0769-4c27-83c5-982c0af0f9d5 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1313 microversion: 2.1 time: 0.165890 Nov 23 14:31:30.583580 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 99/191] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:30 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:30.628157 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ab864f2b-5870-4cd5-98fe-5c269b415ef6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 7493 microversion: 2.20 time: 0.111987 Nov 23 14:31:30.628157 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 93/192] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:30 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 7493 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:31:30.649528 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-651fc8ad-6e4a-4f54-b6fc-9150f88b7f78 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:30.650126 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-651fc8ad-6e4a-4f54-b6fc-9150f88b7f78 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:30.656713 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-651fc8ad-6e4a-4f54-b6fc-9150f88b7f78 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:30.656713 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-651fc8ad-6e4a-4f54-b6fc-9150f88b7f78 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:30.657548 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-651fc8ad-6e4a-4f54-b6fc-9150f88b7f78 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:30.658228 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-651fc8ad-6e4a-4f54-b6fc-9150f88b7f78 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:30.715560 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-651fc8ad-6e4a-4f54-b6fc-9150f88b7f78 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:30.722789 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-651fc8ad-6e4a-4f54-b6fc-9150f88b7f78 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1219 microversion: 2.1 time: 0.077026 Nov 23 14:31:30.723351 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 100/193] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:30 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:30.986768 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b217b1e2-37f7-4a3e-ac74-23be4f53c2ab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:30.987789 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b217b1e2-37f7-4a3e-ac74-23be4f53c2ab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:30.994622 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b217b1e2-37f7-4a3e-ac74-23be4f53c2ab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:30.995062 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b217b1e2-37f7-4a3e-ac74-23be4f53c2ab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:30.995837 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b217b1e2-37f7-4a3e-ac74-23be4f53c2ab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:30.996289 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b217b1e2-37f7-4a3e-ac74-23be4f53c2ab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:31.106076 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b217b1e2-37f7-4a3e-ac74-23be4f53c2ab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 17861 microversion: 2.1 time: 0.124098 Nov 23 14:31:31.106810 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 94/194] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:30 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 17861 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:31:31.431747 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7bb7be54-bdf4-4af7-86e5-fedd53eb475b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:31.432381 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7bb7be54-bdf4-4af7-86e5-fedd53eb475b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:31.439080 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7bb7be54-bdf4-4af7-86e5-fedd53eb475b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:31.439532 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7bb7be54-bdf4-4af7-86e5-fedd53eb475b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:31.440331 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7bb7be54-bdf4-4af7-86e5-fedd53eb475b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:31.440762 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7bb7be54-bdf4-4af7-86e5-fedd53eb475b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:31.532775 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a0c1bfbe-bc10-4a27-a7db-0b893b4dbeb3 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:31.533804 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a0c1bfbe-bc10-4a27-a7db-0b893b4dbeb3 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:31.540809 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a0c1bfbe-bc10-4a27-a7db-0b893b4dbeb3 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:31.541332 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a0c1bfbe-bc10-4a27-a7db-0b893b4dbeb3 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:31.542231 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a0c1bfbe-bc10-4a27-a7db-0b893b4dbeb3 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:31.542730 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a0c1bfbe-bc10-4a27-a7db-0b893b4dbeb3 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:31.574251 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7bb7be54-bdf4-4af7-86e5-fedd53eb475b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:31.582532 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7bb7be54-bdf4-4af7-86e5-fedd53eb475b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.154386 Nov 23 14:31:31.583137 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 101/195] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:31 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:31.600217 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5a7b0157-7253-4721-8dfe-1d0023ef67ee tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:31.600775 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5a7b0157-7253-4721-8dfe-1d0023ef67ee tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:31.606669 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5a7b0157-7253-4721-8dfe-1d0023ef67ee tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:31.607367 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5a7b0157-7253-4721-8dfe-1d0023ef67ee tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:31.608185 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5a7b0157-7253-4721-8dfe-1d0023ef67ee tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:31.608645 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5a7b0157-7253-4721-8dfe-1d0023ef67ee tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:31.677713 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a0c1bfbe-bc10-4a27-a7db-0b893b4dbeb3 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:31.685400 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a0c1bfbe-bc10-4a27-a7db-0b893b4dbeb3 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1554 microversion: 2.1 time: 0.157291 Nov 23 14:31:31.685953 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 95/196] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:31 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:31.695150 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0c2f3f1d-bf87-4e5d-8658-e39a78ccf5b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:31.695150 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0c2f3f1d-bf87-4e5d-8658-e39a78ccf5b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:31.697116 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0c2f3f1d-bf87-4e5d-8658-e39a78ccf5b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:31.697559 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0c2f3f1d-bf87-4e5d-8658-e39a78ccf5b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:31.698324 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0c2f3f1d-bf87-4e5d-8658-e39a78ccf5b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:31.698754 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0c2f3f1d-bf87-4e5d-8658-e39a78ccf5b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:31.739816 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5a7b0157-7253-4721-8dfe-1d0023ef67ee tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:31.747057 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5a7b0157-7253-4721-8dfe-1d0023ef67ee tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1313 microversion: 2.1 time: 0.150606 Nov 23 14:31:31.747623 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 102/197] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:31 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:31.752409 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bb369457-8d82-4f98-bfb5-b5b6f3428a30 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:31.753008 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bb369457-8d82-4f98-bfb5-b5b6f3428a30 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:31.758384 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bb369457-8d82-4f98-bfb5-b5b6f3428a30 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:31.758830 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bb369457-8d82-4f98-bfb5-b5b6f3428a30 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:31.759592 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bb369457-8d82-4f98-bfb5-b5b6f3428a30 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:31.760051 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bb369457-8d82-4f98-bfb5-b5b6f3428a30 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:31.805503 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0c2f3f1d-bf87-4e5d-8658-e39a78ccf5b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 12411 microversion: 2.20 time: 0.118318 Nov 23 14:31:31.806263 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 96/198] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:31 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 12411 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:31:31.819240 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-bb369457-8d82-4f98-bfb5-b5b6f3428a30 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:31.826508 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bb369457-8d82-4f98-bfb5-b5b6f3428a30 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1267 microversion: 2.1 time: 0.077971 Nov 23 14:31:31.827068 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 103/199] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:31 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1267 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:32.118342 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5eb9c454-1a34-4525-b299-7bc6a7fa52c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:32.119327 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5eb9c454-1a34-4525-b299-7bc6a7fa52c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:32.126597 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5eb9c454-1a34-4525-b299-7bc6a7fa52c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:32.127036 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5eb9c454-1a34-4525-b299-7bc6a7fa52c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:32.127806 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5eb9c454-1a34-4525-b299-7bc6a7fa52c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:32.128259 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5eb9c454-1a34-4525-b299-7bc6a7fa52c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:32.598558 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f128cdda-51f5-43ee-9f85-2d81aa630ac0 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:32.599163 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f128cdda-51f5-43ee-9f85-2d81aa630ac0 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:32.605392 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f128cdda-51f5-43ee-9f85-2d81aa630ac0 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:32.605832 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f128cdda-51f5-43ee-9f85-2d81aa630ac0 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:32.606608 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f128cdda-51f5-43ee-9f85-2d81aa630ac0 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:32.607038 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f128cdda-51f5-43ee-9f85-2d81aa630ac0 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:32.737745 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-f128cdda-51f5-43ee-9f85-2d81aa630ac0 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:32.745042 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f128cdda-51f5-43ee-9f85-2d81aa630ac0 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.150233 Nov 23 14:31:32.745603 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 104/200] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:32 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:32.749671 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-cfed5581-c62a-403c-be1b-11f9ee8ed1d9 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:32.750785 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-cfed5581-c62a-403c-be1b-11f9ee8ed1d9 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:32.756166 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cfed5581-c62a-403c-be1b-11f9ee8ed1d9 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:32.756640 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cfed5581-c62a-403c-be1b-11f9ee8ed1d9 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:32.757401 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cfed5581-c62a-403c-be1b-11f9ee8ed1d9 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:32.757830 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cfed5581-c62a-403c-be1b-11f9ee8ed1d9 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:32.885185 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-cfed5581-c62a-403c-be1b-11f9ee8ed1d9 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:32.893722 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-cfed5581-c62a-403c-be1b-11f9ee8ed1d9 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1554 microversion: 2.1 time: 0.147191 Nov 23 14:31:32.894305 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 105/201] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:32 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:32.898824 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-581d49ef-ba4c-422c-bf8a-00a3067e6ad4 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:32.899409 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-581d49ef-ba4c-422c-bf8a-00a3067e6ad4 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:32.904943 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-581d49ef-ba4c-422c-bf8a-00a3067e6ad4 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:32.905376 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-581d49ef-ba4c-422c-bf8a-00a3067e6ad4 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:32.906654 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-581d49ef-ba4c-422c-bf8a-00a3067e6ad4 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:32.907184 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-581d49ef-ba4c-422c-bf8a-00a3067e6ad4 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:33.040475 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-581d49ef-ba4c-422c-bf8a-00a3067e6ad4 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:33.047654 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-581d49ef-ba4c-422c-bf8a-00a3067e6ad4 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1313 microversion: 2.1 time: 0.152201 Nov 23 14:31:33.048217 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 106/202] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:32 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:33.052503 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-65f4487f-4a78-47fc-97ba-3931e50c59ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:33.053438 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-65f4487f-4a78-47fc-97ba-3931e50c59ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:33.058752 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-65f4487f-4a78-47fc-97ba-3931e50c59ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:33.059191 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-65f4487f-4a78-47fc-97ba-3931e50c59ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:33.059955 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-65f4487f-4a78-47fc-97ba-3931e50c59ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:33.060421 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-65f4487f-4a78-47fc-97ba-3931e50c59ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:35.919448 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5eb9c454-1a34-4525-b299-7bc6a7fa52c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 23133 microversion: 2.1 time: 3.804913 Nov 23 14:31:35.920081 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 97/203] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:32 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 23133 bytes in 3807 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:31:35.927350 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6ec65b6e-2e84-4fff-b6a0-8c1344d293db tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:35.928100 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6ec65b6e-2e84-4fff-b6a0-8c1344d293db tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:35.935201 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6ec65b6e-2e84-4fff-b6a0-8c1344d293db tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:35.935652 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6ec65b6e-2e84-4fff-b6a0-8c1344d293db tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:35.936464 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6ec65b6e-2e84-4fff-b6a0-8c1344d293db tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:35.936892 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6ec65b6e-2e84-4fff-b6a0-8c1344d293db tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:35.939802 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-65f4487f-4a78-47fc-97ba-3931e50c59ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 19775 microversion: 2.20 time: 2.890340 Nov 23 14:31:35.945633 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 107/204] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:33 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 19775 bytes in 2892 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:31:35.945750 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-801275a0-10a5-4c44-b31c-ec4fab9a01b3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:35.947143 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-801275a0-10a5-4c44-b31c-ec4fab9a01b3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:35.955292 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-801275a0-10a5-4c44-b31c-ec4fab9a01b3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:35.955730 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-801275a0-10a5-4c44-b31c-ec4fab9a01b3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:35.956533 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-801275a0-10a5-4c44-b31c-ec4fab9a01b3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:35.956957 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-801275a0-10a5-4c44-b31c-ec4fab9a01b3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:36.039486 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6ec65b6e-2e84-4fff-b6a0-8c1344d293db tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:36.048479 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6ec65b6e-2e84-4fff-b6a0-8c1344d293db tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1275 microversion: 2.1 time: 0.125696 Nov 23 14:31:36.049229 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 98/205] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:35 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1275 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:36.058523 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c81ac749-5a07-46dc-b55b-917574b49f95 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:36.058523 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c81ac749-5a07-46dc-b55b-917574b49f95 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:36.060007 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c81ac749-5a07-46dc-b55b-917574b49f95 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:36.060487 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c81ac749-5a07-46dc-b55b-917574b49f95 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:36.061385 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c81ac749-5a07-46dc-b55b-917574b49f95 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:36.061711 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c81ac749-5a07-46dc-b55b-917574b49f95 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:36.104763 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-801275a0-10a5-4c44-b31c-ec4fab9a01b3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:36.113592 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-801275a0-10a5-4c44-b31c-ec4fab9a01b3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.171795 Nov 23 14:31:36.114168 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 108/206] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:35 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:36.128595 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b8429288-155a-41d9-afc9-e8650cdbfa85 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:36.129208 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b8429288-155a-41d9-afc9-e8650cdbfa85 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:36.135138 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b8429288-155a-41d9-afc9-e8650cdbfa85 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:36.135592 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b8429288-155a-41d9-afc9-e8650cdbfa85 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:36.136407 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b8429288-155a-41d9-afc9-e8650cdbfa85 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:36.136843 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b8429288-155a-41d9-afc9-e8650cdbfa85 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:36.278908 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-b8429288-155a-41d9-afc9-e8650cdbfa85 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:36.284821 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c81ac749-5a07-46dc-b55b-917574b49f95 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:36.296484 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b8429288-155a-41d9-afc9-e8650cdbfa85 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1313 microversion: 2.1 time: 0.164654 Nov 23 14:31:36.296484 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 109/207] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:36 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:36.296640 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c81ac749-5a07-46dc-b55b-917574b49f95 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1554 microversion: 2.1 time: 0.243761 Nov 23 14:31:36.296640 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 99/208] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:36 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1554 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:36.931229 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9c71cd2d-ac9d-44d9-9e75-782f28e23b59 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:36.932197 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9c71cd2d-ac9d-44d9-9e75-782f28e23b59 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:36.938836 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9c71cd2d-ac9d-44d9-9e75-782f28e23b59 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:36.939278 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9c71cd2d-ac9d-44d9-9e75-782f28e23b59 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:36.940052 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9c71cd2d-ac9d-44d9-9e75-782f28e23b59 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:36.940617 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9c71cd2d-ac9d-44d9-9e75-782f28e23b59 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:36.954967 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0c895383-0547-4c78-8b6a-5490204b2f27 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:36.955867 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0c895383-0547-4c78-8b6a-5490204b2f27 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:36.962572 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0c895383-0547-4c78-8b6a-5490204b2f27 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:36.963017 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0c895383-0547-4c78-8b6a-5490204b2f27 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:36.963818 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0c895383-0547-4c78-8b6a-5490204b2f27 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:36.964270 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0c895383-0547-4c78-8b6a-5490204b2f27 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:37.368084 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0c895383-0547-4c78-8b6a-5490204b2f27 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 22211 microversion: 2.20 time: 0.416610 Nov 23 14:31:37.377957 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 100/209] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:36 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 22211 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:31:37.384188 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-dbd4417c-9cb9-47f1-a703-d53cbc80921e tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:37.385608 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-dbd4417c-9cb9-47f1-a703-d53cbc80921e tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:37.389191 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9c71cd2d-ac9d-44d9-9e75-782f28e23b59 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 24541 microversion: 2.1 time: 0.460752 Nov 23 14:31:37.389700 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 110/210] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:36 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 24541 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:31:37.394998 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dbd4417c-9cb9-47f1-a703-d53cbc80921e tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:37.395822 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dbd4417c-9cb9-47f1-a703-d53cbc80921e tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:37.396873 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dbd4417c-9cb9-47f1-a703-d53cbc80921e tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:37.397655 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dbd4417c-9cb9-47f1-a703-d53cbc80921e tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:37.400103 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-96afa0c0-fbed-4551-9463-110fea0f930f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:37.400888 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-96afa0c0-fbed-4551-9463-110fea0f930f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:37.415431 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-96afa0c0-fbed-4551-9463-110fea0f930f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:37.415878 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-96afa0c0-fbed-4551-9463-110fea0f930f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:37.416707 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-96afa0c0-fbed-4551-9463-110fea0f930f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:37.417333 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-96afa0c0-fbed-4551-9463-110fea0f930f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:37.627993 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-96afa0c0-fbed-4551-9463-110fea0f930f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:37.635649 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-96afa0c0-fbed-4551-9463-110fea0f930f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.242618 Nov 23 14:31:37.636563 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 111/211] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:37 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:37.641484 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-679f811b-7983-4d63-8b6e-bbf9fc2c3cea tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:37.642197 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-679f811b-7983-4d63-8b6e-bbf9fc2c3cea tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:37.647929 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-679f811b-7983-4d63-8b6e-bbf9fc2c3cea tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:37.648608 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-679f811b-7983-4d63-8b6e-bbf9fc2c3cea tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:37.650462 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-679f811b-7983-4d63-8b6e-bbf9fc2c3cea tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:37.650462 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-679f811b-7983-4d63-8b6e-bbf9fc2c3cea tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:37.706968 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-dbd4417c-9cb9-47f1-a703-d53cbc80921e tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:37.715623 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-dbd4417c-9cb9-47f1-a703-d53cbc80921e tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1315 microversion: 2.1 time: 0.336057 Nov 23 14:31:37.716280 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 101/212] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:37 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:37.721227 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c2268322-57d8-461e-815a-3942fc3769e4 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:37.722027 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c2268322-57d8-461e-815a-3942fc3769e4 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:37.727958 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c2268322-57d8-461e-815a-3942fc3769e4 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:37.728639 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c2268322-57d8-461e-815a-3942fc3769e4 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:37.729713 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c2268322-57d8-461e-815a-3942fc3769e4 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:37.730299 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c2268322-57d8-461e-815a-3942fc3769e4 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:37.946574 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c2268322-57d8-461e-815a-3942fc3769e4 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:37.955972 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c2268322-57d8-461e-815a-3942fc3769e4 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1554 microversion: 2.1 time: 0.238523 Nov 23 14:31:37.962715 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 102/213] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:37 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1554 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:37.968606 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-33550a3a-8c2d-4e86-9ab7-4066c84367de req-e62329de-b4aa-4a6b-a735-e8aa4c2dad34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c149ec46-47c0-4d43-abc6-ee2c901ab9b2", "name": "network-vif-plugged", "status": "completed", "tag": "0a48ea27-4a0b-401b-90ef-02b2cb56e046"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:37.970817 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:31:37.970817 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:31:37.978532 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-33550a3a-8c2d-4e86-9ab7-4066c84367de req-e62329de-b4aa-4a6b-a735-e8aa4c2dad34 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:37.979171 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-33550a3a-8c2d-4e86-9ab7-4066c84367de req-e62329de-b4aa-4a6b-a735-e8aa4c2dad34 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:37.990587 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-33550a3a-8c2d-4e86-9ab7-4066c84367de req-e62329de-b4aa-4a6b-a735-e8aa4c2dad34 service nova] Creating event network-vif-plugged:0a48ea27-4a0b-401b-90ef-02b2cb56e046 for instance c149ec46-47c0-4d43-abc6-ee2c901ab9b2 on hv-cinder-80475 Nov 23 14:31:37.995317 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-33550a3a-8c2d-4e86-9ab7-4066c84367de req-e62329de-b4aa-4a6b-a735-e8aa4c2dad34 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031520 Nov 23 14:31:37.995915 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 103/214] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:31:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:31:38.026386 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-679f811b-7983-4d63-8b6e-bbf9fc2c3cea tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:38.034853 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-679f811b-7983-4d63-8b6e-bbf9fc2c3cea tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1313 microversion: 2.1 time: 0.397227 Nov 23 14:31:38.035429 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 112/215] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:37 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:38.388297 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8f1a3c73-2c28-45f1-9ef5-08db8634af2e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:38.389337 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8f1a3c73-2c28-45f1-9ef5-08db8634af2e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:38.399150 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8f1a3c73-2c28-45f1-9ef5-08db8634af2e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:38.400300 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8f1a3c73-2c28-45f1-9ef5-08db8634af2e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:38.401381 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8f1a3c73-2c28-45f1-9ef5-08db8634af2e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:38.401890 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8f1a3c73-2c28-45f1-9ef5-08db8634af2e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:38.402894 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a1f57e14-dbb0-489b-926d-cbcc41240355 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:38.403807 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a1f57e14-dbb0-489b-926d-cbcc41240355 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:38.411759 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a1f57e14-dbb0-489b-926d-cbcc41240355 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:38.412186 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a1f57e14-dbb0-489b-926d-cbcc41240355 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:38.413522 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a1f57e14-dbb0-489b-926d-cbcc41240355 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:38.413957 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a1f57e14-dbb0-489b-926d-cbcc41240355 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:43.211522 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8f1a3c73-2c28-45f1-9ef5-08db8634af2e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 27374 microversion: 2.20 time: 4.831000 Nov 23 14:31:43.217302 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 104/216] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:38 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 27374 bytes in 4833 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:31:43.219276 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8f3da566-5b14-4578-a7d6-e42dd5b7d36c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:43.223213 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8f3da566-5b14-4578-a7d6-e42dd5b7d36c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:43.227781 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8f3da566-5b14-4578-a7d6-e42dd5b7d36c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:43.228318 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8f3da566-5b14-4578-a7d6-e42dd5b7d36c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:43.229046 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8f3da566-5b14-4578-a7d6-e42dd5b7d36c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:43.229482 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8f3da566-5b14-4578-a7d6-e42dd5b7d36c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:43.240006 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a1f57e14-dbb0-489b-926d-cbcc41240355 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 27653 microversion: 2.1 time: 4.840840 Nov 23 14:31:43.244309 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 113/217] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:38 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 27653 bytes in 4843 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:31:43.250299 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-722f817f-b8e1-44c5-8ddf-e9942f7e5479 req-af5a6d6e-3aa6-4aa6-90c2-01b233f56e5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5679ae88-fa1c-4372-ae6c-f947c4a711e1", "tag": "11762584-9dd1-40ad-bff7-ec6d4d6dd36a"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:43.252648 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:31:43.252648 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:31:43.282875 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-722f817f-b8e1-44c5-8ddf-e9942f7e5479 req-af5a6d6e-3aa6-4aa6-90c2-01b233f56e5d service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:43.283119 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-722f817f-b8e1-44c5-8ddf-e9942f7e5479 req-af5a6d6e-3aa6-4aa6-90c2-01b233f56e5d service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:43.297023 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-722f817f-b8e1-44c5-8ddf-e9942f7e5479 req-af5a6d6e-3aa6-4aa6-90c2-01b233f56e5d service nova] Creating event network-changed:11762584-9dd1-40ad-bff7-ec6d4d6dd36a for instance 5679ae88-fa1c-4372-ae6c-f947c4a711e1 on hv-cinder-80475 Nov 23 14:31:43.301915 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-722f817f-b8e1-44c5-8ddf-e9942f7e5479 req-af5a6d6e-3aa6-4aa6-90c2-01b233f56e5d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059134 Nov 23 14:31:43.303109 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 114/218] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:31:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:31:43.308791 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-04ad8452-692f-4b69-ac99-87feedb08bfd tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:43.309701 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-04ad8452-692f-4b69-ac99-87feedb08bfd tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:43.320458 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-04ad8452-692f-4b69-ac99-87feedb08bfd tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:43.320913 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-04ad8452-692f-4b69-ac99-87feedb08bfd tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:43.321704 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-04ad8452-692f-4b69-ac99-87feedb08bfd tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:43.322444 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-04ad8452-692f-4b69-ac99-87feedb08bfd tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:43.404806 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-8f3da566-5b14-4578-a7d6-e42dd5b7d36c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:43.413528 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8f3da566-5b14-4578-a7d6-e42dd5b7d36c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.199400 Nov 23 14:31:43.414389 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 105/219] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:43 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:43.418834 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-48ab64e5-22dd-4345-8648-eb933cf655c5 req-54263fca-11f3-40f1-a50a-a3f6d7798323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd32f487-0ba1-4203-b38d-e8c98996571b", "name": "network-vif-deleted", "tag": "13c1d6ed-047c-49db-9ca5-88949c465a08"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:43.420523 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:31:43.420523 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:31:43.428022 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-48ab64e5-22dd-4345-8648-eb933cf655c5 req-54263fca-11f3-40f1-a50a-a3f6d7798323 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:43.428601 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-48ab64e5-22dd-4345-8648-eb933cf655c5 req-54263fca-11f3-40f1-a50a-a3f6d7798323 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:43.440270 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-48ab64e5-22dd-4345-8648-eb933cf655c5 req-54263fca-11f3-40f1-a50a-a3f6d7798323 service nova] Creating event network-vif-deleted:13c1d6ed-047c-49db-9ca5-88949c465a08 for instance fd32f487-0ba1-4203-b38d-e8c98996571b on hv-cinder-80475 Nov 23 14:31:43.445116 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-48ab64e5-22dd-4345-8648-eb933cf655c5 req-54263fca-11f3-40f1-a50a-a3f6d7798323 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029600 Nov 23 14:31:43.445890 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 106/220] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:31:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:31:43.450770 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a76895eb-d418-4061-a1e3-e0b1241ec1e5 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:43.451457 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a76895eb-d418-4061-a1e3-e0b1241ec1e5 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:43.457684 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a76895eb-d418-4061-a1e3-e0b1241ec1e5 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:43.458133 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a76895eb-d418-4061-a1e3-e0b1241ec1e5 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:43.458911 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a76895eb-d418-4061-a1e3-e0b1241ec1e5 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:43.459345 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a76895eb-d418-4061-a1e3-e0b1241ec1e5 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:43.513993 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-04ad8452-692f-4b69-ac99-87feedb08bfd tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:43.522195 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-04ad8452-692f-4b69-ac99-87feedb08bfd tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1315 microversion: 2.1 time: 0.217748 Nov 23 14:31:43.522769 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 115/221] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:43 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:43.527053 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-96399cd2-7db5-4e90-a66c-3b6aa82e2505 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:43.527648 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-96399cd2-7db5-4e90-a66c-3b6aa82e2505 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:43.528193 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a76895eb-d418-4061-a1e3-e0b1241ec1e5 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:43.534508 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-96399cd2-7db5-4e90-a66c-3b6aa82e2505 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:43.534954 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-96399cd2-7db5-4e90-a66c-3b6aa82e2505 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:43.535733 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-96399cd2-7db5-4e90-a66c-3b6aa82e2505 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:43.536166 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-96399cd2-7db5-4e90-a66c-3b6aa82e2505 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:43.536436 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a76895eb-d418-4061-a1e3-e0b1241ec1e5 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1346 microversion: 2.1 time: 0.089329 Nov 23 14:31:43.536991 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 107/222] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:43 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:43.696536 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-96399cd2-7db5-4e90-a66c-3b6aa82e2505 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:43.704114 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-96399cd2-7db5-4e90-a66c-3b6aa82e2505 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1313 microversion: 2.1 time: 0.180075 Nov 23 14:31:43.705074 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 116/223] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:43 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:44.232649 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ce4f51c4-aac2-48fc-b924-b7c2095df2ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:44.233510 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ce4f51c4-aac2-48fc-b924-b7c2095df2ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:44.240761 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ce4f51c4-aac2-48fc-b924-b7c2095df2ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:44.244969 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ce4f51c4-aac2-48fc-b924-b7c2095df2ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:44.244969 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ce4f51c4-aac2-48fc-b924-b7c2095df2ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:44.244969 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ce4f51c4-aac2-48fc-b924-b7c2095df2ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:44.251728 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-541358b7-6b4e-4f60-a5c3-9d3c7a653792 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:44.252750 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-541358b7-6b4e-4f60-a5c3-9d3c7a653792 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:44.259052 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-541358b7-6b4e-4f60-a5c3-9d3c7a653792 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:44.259485 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-541358b7-6b4e-4f60-a5c3-9d3c7a653792 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:44.260259 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-541358b7-6b4e-4f60-a5c3-9d3c7a653792 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:44.260698 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-541358b7-6b4e-4f60-a5c3-9d3c7a653792 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:44.443435 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ce4f51c4-aac2-48fc-b924-b7c2095df2ad tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 27661 microversion: 2.20 time: 0.214611 Nov 23 14:31:44.447219 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 108/224] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:44 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 27661 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:31:44.449038 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-dc9177e4-d0fc-401a-81b4-5a79b167ea52 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:44.449721 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-dc9177e4-d0fc-401a-81b4-5a79b167ea52 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:44.456803 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dc9177e4-d0fc-401a-81b4-5a79b167ea52 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:44.457252 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dc9177e4-d0fc-401a-81b4-5a79b167ea52 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:44.458024 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dc9177e4-d0fc-401a-81b4-5a79b167ea52 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:44.458456 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dc9177e4-d0fc-401a-81b4-5a79b167ea52 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:44.475352 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-541358b7-6b4e-4f60-a5c3-9d3c7a653792 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 27768 microversion: 2.1 time: 0.227811 Nov 23 14:31:44.476007 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 117/225] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:44 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 27768 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:31:44.540693 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e52c32a4-10bb-4f1e-92d2-1fa08b05e01f tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:44.541526 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e52c32a4-10bb-4f1e-92d2-1fa08b05e01f tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:44.550397 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e52c32a4-10bb-4f1e-92d2-1fa08b05e01f tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:44.551145 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e52c32a4-10bb-4f1e-92d2-1fa08b05e01f tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:44.553277 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e52c32a4-10bb-4f1e-92d2-1fa08b05e01f tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:44.554637 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e52c32a4-10bb-4f1e-92d2-1fa08b05e01f tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:44.597099 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-dc9177e4-d0fc-401a-81b4-5a79b167ea52 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:44.604768 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-dc9177e4-d0fc-401a-81b4-5a79b167ea52 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.159424 Nov 23 14:31:44.605544 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 109/226] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:44 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:44.609685 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6f48c86c-1cf3-415a-9ec5-7aaacd3a9a77 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:44.610666 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6f48c86c-1cf3-415a-9ec5-7aaacd3a9a77 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:44.616550 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6f48c86c-1cf3-415a-9ec5-7aaacd3a9a77 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:44.616998 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6f48c86c-1cf3-415a-9ec5-7aaacd3a9a77 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:44.617774 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6f48c86c-1cf3-415a-9ec5-7aaacd3a9a77 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:44.618251 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6f48c86c-1cf3-415a-9ec5-7aaacd3a9a77 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:44.683828 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6f48c86c-1cf3-415a-9ec5-7aaacd3a9a77 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:44.693258 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6f48c86c-1cf3-415a-9ec5-7aaacd3a9a77 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1346 microversion: 2.1 time: 0.086730 Nov 23 14:31:44.693936 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 110/227] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:44 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:44.721337 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6fdc92f1-63ce-4635-979e-3c8475c0190c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:44.721884 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6fdc92f1-63ce-4635-979e-3c8475c0190c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:44.728672 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6fdc92f1-63ce-4635-979e-3c8475c0190c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:44.729275 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6fdc92f1-63ce-4635-979e-3c8475c0190c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:44.730371 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6fdc92f1-63ce-4635-979e-3c8475c0190c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:44.731052 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6fdc92f1-63ce-4635-979e-3c8475c0190c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:44.762407 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e52c32a4-10bb-4f1e-92d2-1fa08b05e01f tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:44.770299 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e52c32a4-10bb-4f1e-92d2-1fa08b05e01f tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1315 microversion: 2.1 time: 0.234444 Nov 23 14:31:44.770812 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 118/228] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:44 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:44.872032 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6fdc92f1-63ce-4635-979e-3c8475c0190c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:44.880141 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6fdc92f1-63ce-4635-979e-3c8475c0190c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1313 microversion: 2.1 time: 0.162915 Nov 23 14:31:44.880736 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 111/229] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:44 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:45.455228 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-eb94e8b3-db41-4886-b947-3c079ed89f9d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:45.456172 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-eb94e8b3-db41-4886-b947-3c079ed89f9d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:45.462662 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-eb94e8b3-db41-4886-b947-3c079ed89f9d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:45.463117 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-eb94e8b3-db41-4886-b947-3c079ed89f9d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:45.464045 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-eb94e8b3-db41-4886-b947-3c079ed89f9d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:45.464503 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-eb94e8b3-db41-4886-b947-3c079ed89f9d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:45.486997 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c20e3b29-3477-4e00-9cba-ef2aa8d4c7ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:45.488047 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c20e3b29-3477-4e00-9cba-ef2aa8d4c7ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:45.495870 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c20e3b29-3477-4e00-9cba-ef2aa8d4c7ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:45.499110 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c20e3b29-3477-4e00-9cba-ef2aa8d4c7ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:45.499110 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c20e3b29-3477-4e00-9cba-ef2aa8d4c7ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:45.499110 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c20e3b29-3477-4e00-9cba-ef2aa8d4c7ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:45.954489 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c20e3b29-3477-4e00-9cba-ef2aa8d4c7ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 27834 microversion: 2.1 time: 0.470653 Nov 23 14:31:45.958310 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 112/230] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:45 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 27834 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:31:45.960349 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-12505f6b-472a-4a63-a9ef-c056faf6b88e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:45.961039 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-12505f6b-472a-4a63-a9ef-c056faf6b88e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:45.967929 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-12505f6b-472a-4a63-a9ef-c056faf6b88e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:45.968520 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-12505f6b-472a-4a63-a9ef-c056faf6b88e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:45.969922 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-12505f6b-472a-4a63-a9ef-c056faf6b88e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:45.970321 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-12505f6b-472a-4a63-a9ef-c056faf6b88e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:45.973820 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-eb94e8b3-db41-4886-b947-3c079ed89f9d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 27834 microversion: 2.20 time: 0.522964 Nov 23 14:31:45.978401 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 119/231] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:45 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 27834 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:31:45.984109 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-22b349f7-baef-436a-aa3b-997aac498938 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:45.986025 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-22b349f7-baef-436a-aa3b-997aac498938 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:45.993544 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-22b349f7-baef-436a-aa3b-997aac498938 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:45.994225 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-22b349f7-baef-436a-aa3b-997aac498938 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:45.996264 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-22b349f7-baef-436a-aa3b-997aac498938 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:45.997055 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-22b349f7-baef-436a-aa3b-997aac498938 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:46.033899 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-22b349f7-baef-436a-aa3b-997aac498938 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:46.034338 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-22b349f7-baef-436a-aa3b-997aac498938 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:46.034794 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.objects.instance [None req-22b349f7-baef-436a-aa3b-997aac498938 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lazy-loading 'fault' on Instance uuid fd32f487-0ba1-4203-b38d-e8c98996571b {{(pid=116788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:31:46.086864 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-22b349f7-baef-436a-aa3b-997aac498938 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f4c018a8804e2ab109fede8fccc62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6dcdf0bd0d4ba4b54402a4c1cc6023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:46.095802 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-22b349f7-baef-436a-aa3b-997aac498938 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 200 len: 1351 microversion: 2.1 time: 0.115586 Nov 23 14:31:46.105541 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 120/232] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:45 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 1351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:46.105541 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-0221c152-ce19-4c75-8981-6f96f0b0c44b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:46.105541 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-0221c152-ce19-4c75-8981-6f96f0b0c44b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:46.107931 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0221c152-ce19-4c75-8981-6f96f0b0c44b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:46.108430 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0221c152-ce19-4c75-8981-6f96f0b0c44b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:46.109199 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0221c152-ce19-4c75-8981-6f96f0b0c44b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:46.109628 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0221c152-ce19-4c75-8981-6f96f0b0c44b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:46.117375 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-12505f6b-472a-4a63-a9ef-c056faf6b88e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:46.124519 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-12505f6b-472a-4a63-a9ef-c056faf6b88e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.168078 Nov 23 14:31:46.125090 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 113/233] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:45 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:46.129726 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6cfd153b-0b89-4994-a14e-cad1dc87d9a9 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:46.130185 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6cfd153b-0b89-4994-a14e-cad1dc87d9a9 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:46.135718 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6cfd153b-0b89-4994-a14e-cad1dc87d9a9 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:46.136166 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6cfd153b-0b89-4994-a14e-cad1dc87d9a9 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:46.136974 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6cfd153b-0b89-4994-a14e-cad1dc87d9a9 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:46.137450 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6cfd153b-0b89-4994-a14e-cad1dc87d9a9 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:46.261351 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-0221c152-ce19-4c75-8981-6f96f0b0c44b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:46.272060 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-0221c152-ce19-4c75-8981-6f96f0b0c44b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1315 microversion: 2.1 time: 0.174244 Nov 23 14:31:46.283222 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 121/234] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:46 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:46.331535 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6cfd153b-0b89-4994-a14e-cad1dc87d9a9 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:46.338795 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6cfd153b-0b89-4994-a14e-cad1dc87d9a9 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1313 microversion: 2.1 time: 0.212778 Nov 23 14:31:46.339362 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 114/235] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:46 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:46.965875 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ff9086b0-ad45-442c-a439-b3954672d24a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:46.966778 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ff9086b0-ad45-442c-a439-b3954672d24a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:46.973470 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ff9086b0-ad45-442c-a439-b3954672d24a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:46.973910 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ff9086b0-ad45-442c-a439-b3954672d24a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:46.974675 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ff9086b0-ad45-442c-a439-b3954672d24a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:46.975106 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ff9086b0-ad45-442c-a439-b3954672d24a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:46.985399 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e5f3a421-8f64-4d39-abba-30b0830ac433 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:46.987045 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e5f3a421-8f64-4d39-abba-30b0830ac433 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:46.993245 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e5f3a421-8f64-4d39-abba-30b0830ac433 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:46.993698 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e5f3a421-8f64-4d39-abba-30b0830ac433 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:46.994475 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e5f3a421-8f64-4d39-abba-30b0830ac433 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:46.994906 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e5f3a421-8f64-4d39-abba-30b0830ac433 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:47.115211 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ff9086b0-ad45-442c-a439-b3954672d24a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28013 microversion: 2.1 time: 0.152760 Nov 23 14:31:47.115907 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 122/236] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:46 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28013 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:31:47.121482 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-741882f4-4ea5-4a84-ad5c-bb121f5d9372 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:47.122171 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-741882f4-4ea5-4a84-ad5c-bb121f5d9372 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:47.123982 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e5f3a421-8f64-4d39-abba-30b0830ac433 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 27834 microversion: 2.20 time: 0.141924 Nov 23 14:31:47.127087 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 115/237] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:46 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 27834 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:31:47.140654 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-741882f4-4ea5-4a84-ad5c-bb121f5d9372 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:47.140654 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-741882f4-4ea5-4a84-ad5c-bb121f5d9372 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:47.140654 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-741882f4-4ea5-4a84-ad5c-bb121f5d9372 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:47.140654 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-741882f4-4ea5-4a84-ad5c-bb121f5d9372 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:47.141792 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a151dd49-b0e9-401c-a5dd-b0e5b5456463 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:47.143285 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a151dd49-b0e9-401c-a5dd-b0e5b5456463 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:47.148138 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-741882f4-4ea5-4a84-ad5c-bb121f5d9372 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] HTTP exception thrown: Instance fd32f487-0ba1-4203-b38d-e8c98996571b could not be found. Nov 23 14:31:47.149176 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-741882f4-4ea5-4a84-ad5c-bb121f5d9372 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Returning 404 to user: Instance fd32f487-0ba1-4203-b38d-e8c98996571b could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:31:47.149595 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-741882f4-4ea5-4a84-ad5c-bb121f5d9372 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 404 len: 111 microversion: 2.1 time: 0.032571 Nov 23 14:31:47.150304 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 123/238] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:47 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:31:47.150632 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a151dd49-b0e9-401c-a5dd-b0e5b5456463 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:47.151081 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a151dd49-b0e9-401c-a5dd-b0e5b5456463 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:47.151860 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a151dd49-b0e9-401c-a5dd-b0e5b5456463 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:47.152312 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a151dd49-b0e9-401c-a5dd-b0e5b5456463 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:47.252086 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-84ad8cab-5e94-49aa-a15e-46aea5c85480 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:47.253188 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-84ad8cab-5e94-49aa-a15e-46aea5c85480 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:47.259294 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-84ad8cab-5e94-49aa-a15e-46aea5c85480 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:47.259732 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-84ad8cab-5e94-49aa-a15e-46aea5c85480 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:47.260647 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-84ad8cab-5e94-49aa-a15e-46aea5c85480 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:47.260984 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-84ad8cab-5e94-49aa-a15e-46aea5c85480 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:47.274536 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-84ad8cab-5e94-49aa-a15e-46aea5c85480 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] HTTP exception thrown: Instance fd32f487-0ba1-4203-b38d-e8c98996571b could not be found. Nov 23 14:31:47.275114 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-84ad8cab-5e94-49aa-a15e-46aea5c85480 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Returning 404 to user: Instance fd32f487-0ba1-4203-b38d-e8c98996571b could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:31:47.275924 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-84ad8cab-5e94-49aa-a15e-46aea5c85480 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028040 Nov 23 14:31:47.276803 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 124/239] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:31:47 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 14:31:47.296318 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5158a4dc-a69b-413b-9a63-fb5774319a4b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:47.296318 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5158a4dc-a69b-413b-9a63-fb5774319a4b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:47.300793 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5158a4dc-a69b-413b-9a63-fb5774319a4b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:47.301237 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5158a4dc-a69b-413b-9a63-fb5774319a4b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:47.302037 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5158a4dc-a69b-413b-9a63-fb5774319a4b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:47.302565 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5158a4dc-a69b-413b-9a63-fb5774319a4b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:47.303348 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a151dd49-b0e9-401c-a5dd-b0e5b5456463 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:47.312817 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a151dd49-b0e9-401c-a5dd-b0e5b5456463 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.174978 Nov 23 14:31:47.313778 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 116/240] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:47 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:47.355731 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9be75aa1-68e7-4068-83ea-3ae70b183041 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:47.356508 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9be75aa1-68e7-4068-83ea-3ae70b183041 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:47.364801 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9be75aa1-68e7-4068-83ea-3ae70b183041 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:47.365602 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9be75aa1-68e7-4068-83ea-3ae70b183041 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:47.367040 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9be75aa1-68e7-4068-83ea-3ae70b183041 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:47.367697 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9be75aa1-68e7-4068-83ea-3ae70b183041 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:47.457373 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5158a4dc-a69b-413b-9a63-fb5774319a4b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:47.464997 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5158a4dc-a69b-413b-9a63-fb5774319a4b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1315 microversion: 2.1 time: 0.176251 Nov 23 14:31:47.474563 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 125/241] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:47 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:47.506723 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9be75aa1-68e7-4068-83ea-3ae70b183041 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:47.514464 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9be75aa1-68e7-4068-83ea-3ae70b183041 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1498 microversion: 2.1 time: 0.162333 Nov 23 14:31:47.515022 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 117/242] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:47 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:48.126873 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6926806f-e3d2-463f-9a9d-0ec73f601c0b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:48.128642 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6926806f-e3d2-463f-9a9d-0ec73f601c0b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:48.134983 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6926806f-e3d2-463f-9a9d-0ec73f601c0b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:48.135411 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6926806f-e3d2-463f-9a9d-0ec73f601c0b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:48.136169 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6926806f-e3d2-463f-9a9d-0ec73f601c0b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:48.136621 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6926806f-e3d2-463f-9a9d-0ec73f601c0b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:48.148464 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ed32b058-83b8-42b3-bde8-613506e2ce02 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:48.149358 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ed32b058-83b8-42b3-bde8-613506e2ce02 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:48.155453 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ed32b058-83b8-42b3-bde8-613506e2ce02 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:48.155897 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ed32b058-83b8-42b3-bde8-613506e2ce02 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:48.156706 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ed32b058-83b8-42b3-bde8-613506e2ce02 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:48.157138 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ed32b058-83b8-42b3-bde8-613506e2ce02 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:52.970500 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6926806f-e3d2-463f-9a9d-0ec73f601c0b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28013 microversion: 2.1 time: 4.847123 Nov 23 14:31:52.974464 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 126/243] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:48 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28013 bytes in 4849 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:31:52.976428 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-de7c296b-72d5-4739-9928-642924d81f3e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:52.977107 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-de7c296b-72d5-4739-9928-642924d81f3e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:52.983895 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-de7c296b-72d5-4739-9928-642924d81f3e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:52.984368 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-de7c296b-72d5-4739-9928-642924d81f3e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:52.985148 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-de7c296b-72d5-4739-9928-642924d81f3e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:52.985582 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-de7c296b-72d5-4739-9928-642924d81f3e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:52.998736 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ed32b058-83b8-42b3-bde8-613506e2ce02 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 27900 microversion: 2.20 time: 4.853871 Nov 23 14:31:53.003355 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 118/244] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:48 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 27900 bytes in 4856 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:31:53.005436 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-05d466ef-8cd2-4a38-b536-9945e57cdc7e tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:53.006217 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-05d466ef-8cd2-4a38-b536-9945e57cdc7e tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:53.014952 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-05d466ef-8cd2-4a38-b536-9945e57cdc7e tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:53.016347 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-05d466ef-8cd2-4a38-b536-9945e57cdc7e tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:53.017199 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-05d466ef-8cd2-4a38-b536-9945e57cdc7e tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:53.017637 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-05d466ef-8cd2-4a38-b536-9945e57cdc7e tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:53.122254 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-de7c296b-72d5-4739-9928-642924d81f3e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:53.131561 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-de7c296b-72d5-4739-9928-642924d81f3e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.158870 Nov 23 14:31:53.132372 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 127/245] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:52 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:53.153408 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-05d466ef-8cd2-4a38-b536-9945e57cdc7e tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:53.160733 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-05d466ef-8cd2-4a38-b536-9945e57cdc7e tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1315 microversion: 2.1 time: 0.159827 Nov 23 14:31:53.161394 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 119/246] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:52 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:53.981925 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-34a7fc49-fe7d-4a19-8fe1-19e532e027bd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:53.982885 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-34a7fc49-fe7d-4a19-8fe1-19e532e027bd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:53.989570 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-34a7fc49-fe7d-4a19-8fe1-19e532e027bd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:53.990017 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-34a7fc49-fe7d-4a19-8fe1-19e532e027bd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:53.990787 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-34a7fc49-fe7d-4a19-8fe1-19e532e027bd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:53.991215 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-34a7fc49-fe7d-4a19-8fe1-19e532e027bd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:54.012854 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2df35bee-41e7-4428-8565-2ba0187c107b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:54.014512 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2df35bee-41e7-4428-8565-2ba0187c107b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:54.022036 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2df35bee-41e7-4428-8565-2ba0187c107b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:54.022689 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2df35bee-41e7-4428-8565-2ba0187c107b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:54.023578 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2df35bee-41e7-4428-8565-2ba0187c107b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:54.024013 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2df35bee-41e7-4428-8565-2ba0187c107b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:54.121710 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2df35bee-41e7-4428-8565-2ba0187c107b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28012 microversion: 2.20 time: 0.112613 Nov 23 14:31:54.122376 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 120/247] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:54 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28012 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:31:54.141005 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-14f47bd2-e4aa-4269-8ebd-74e27228fe88 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:54.141581 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-14f47bd2-e4aa-4269-8ebd-74e27228fe88 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:54.149135 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-14f47bd2-e4aa-4269-8ebd-74e27228fe88 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:54.149576 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-14f47bd2-e4aa-4269-8ebd-74e27228fe88 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:54.150345 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-14f47bd2-e4aa-4269-8ebd-74e27228fe88 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:54.150852 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-14f47bd2-e4aa-4269-8ebd-74e27228fe88 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:54.171289 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-34a7fc49-fe7d-4a19-8fe1-19e532e027bd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.192926 Nov 23 14:31:54.172755 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 128/248] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:53 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:31:54.177098 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-14f47bd2-e4aa-4269-8ebd-74e27228fe88 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Going to try to terminate instance {{(pid=116787) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:31:54.178299 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-16679615-dc60-4e34-af5c-4f7d761bf740 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:54.179002 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-16679615-dc60-4e34-af5c-4f7d761bf740 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:54.185974 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-16679615-dc60-4e34-af5c-4f7d761bf740 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:54.186635 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-16679615-dc60-4e34-af5c-4f7d761bf740 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:54.187402 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-16679615-dc60-4e34-af5c-4f7d761bf740 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:54.188022 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-16679615-dc60-4e34-af5c-4f7d761bf740 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:54.329666 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-16679615-dc60-4e34-af5c-4f7d761bf740 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:54.337901 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-16679615-dc60-4e34-af5c-4f7d761bf740 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.163741 Nov 23 14:31:54.338688 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 129/249] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:54 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:54.352445 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7b626221-d364-4739-b96e-20a323f26125 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:54.355965 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7b626221-d364-4739-b96e-20a323f26125 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:54.359056 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7b626221-d364-4739-b96e-20a323f26125 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:54.359507 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7b626221-d364-4739-b96e-20a323f26125 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:54.360423 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7b626221-d364-4739-b96e-20a323f26125 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:54.360852 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7b626221-d364-4739-b96e-20a323f26125 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:54.395079 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-14f47bd2-e4aa-4269-8ebd-74e27228fe88 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 204 len: 0 microversion: 2.1 time: 0.257645 Nov 23 14:31:54.395679 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 121/250] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:31:54 2021] DELETE /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 14:31:54.403947 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4b02ac1b-afc0-4d12-90b1-157b64bd938a tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:54.404666 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4b02ac1b-afc0-4d12-90b1-157b64bd938a tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:54.411209 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4b02ac1b-afc0-4d12-90b1-157b64bd938a tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:54.412399 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4b02ac1b-afc0-4d12-90b1-157b64bd938a tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:54.413864 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4b02ac1b-afc0-4d12-90b1-157b64bd938a tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:54.414298 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4b02ac1b-afc0-4d12-90b1-157b64bd938a tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:54.498593 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7b626221-d364-4739-b96e-20a323f26125 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:54.506937 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7b626221-d364-4739-b96e-20a323f26125 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1315 microversion: 2.1 time: 0.158012 Nov 23 14:31:54.507832 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 130/251] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:54 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:54.556506 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4b02ac1b-afc0-4d12-90b1-157b64bd938a tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:54.563967 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4b02ac1b-afc0-4d12-90b1-157b64bd938a tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1504 microversion: 2.1 time: 0.163834 Nov 23 14:31:54.564610 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 122/252] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:54 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:31:54.951610 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-64b5d6ca-b6d5-4620-b5bc-66e204d631f7 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:54.952094 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-64b5d6ca-b6d5-4620-b5bc-66e204d631f7 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:54.958920 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-64b5d6ca-b6d5-4620-b5bc-66e204d631f7 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:54.959356 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-64b5d6ca-b6d5-4620-b5bc-66e204d631f7 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:54.960117 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-64b5d6ca-b6d5-4620-b5bc-66e204d631f7 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:54.960564 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-64b5d6ca-b6d5-4620-b5bc-66e204d631f7 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:54.976891 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-64b5d6ca-b6d5-4620-b5bc-66e204d631f7 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] HTTP exception thrown: Instance fd32f487-0ba1-4203-b38d-e8c98996571b could not be found. Nov 23 14:31:54.977593 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-64b5d6ca-b6d5-4620-b5bc-66e204d631f7 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Returning 404 to user: Instance fd32f487-0ba1-4203-b38d-e8c98996571b could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:31:54.978513 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-64b5d6ca-b6d5-4620-b5bc-66e204d631f7 tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "DELETE /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 404 len: 111 microversion: 2.1 time: 0.030482 Nov 23 14:31:54.979551 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 131/253] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:31:54 2021] DELETE /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:31:54.987717 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0d3a93b6-9782-4da3-b17c-dc7233b4d59a tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:54.988488 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0d3a93b6-9782-4da3-b17c-dc7233b4d59a tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] [instance: fd32f487-0ba1-4203-b38d-e8c98996571b] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:54.995211 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0d3a93b6-9782-4da3-b17c-dc7233b4d59a tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:54.995675 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0d3a93b6-9782-4da3-b17c-dc7233b4d59a tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:54.996541 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0d3a93b6-9782-4da3-b17c-dc7233b4d59a tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:54.997192 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0d3a93b6-9782-4da3-b17c-dc7233b4d59a tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:55.011649 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-0d3a93b6-9782-4da3-b17c-dc7233b4d59a tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] HTTP exception thrown: Instance fd32f487-0ba1-4203-b38d-e8c98996571b could not be found. Nov 23 14:31:55.012154 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0d3a93b6-9782-4da3-b17c-dc7233b4d59a tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] Returning 404 to user: Instance fd32f487-0ba1-4203-b38d-e8c98996571b could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:31:55.013056 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0d3a93b6-9782-4da3-b17c-dc7233b4d59a tempest-DeleteServersTestJSON-1900653720 tempest-DeleteServersTestJSON-1900653720-project] 10.222.0.82 "GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b" status: 404 len: 111 microversion: 2.1 time: 0.029556 Nov 23 14:31:55.013963 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 123/254] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:54 2021] GET /compute/v2.1/servers/fd32f487-0ba1-4203-b38d-e8c98996571b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:31:55.134450 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d522ffd2-f6ae-45a3-ace4-61ed308a13b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:55.135345 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d522ffd2-f6ae-45a3-ace4-61ed308a13b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:55.141242 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d522ffd2-f6ae-45a3-ace4-61ed308a13b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:55.141677 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d522ffd2-f6ae-45a3-ace4-61ed308a13b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:55.142438 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d522ffd2-f6ae-45a3-ace4-61ed308a13b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:55.143014 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d522ffd2-f6ae-45a3-ace4-61ed308a13b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:55.183290 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c29b19df-8c0b-4c3a-b7ef-1963d9b9dfc1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:55.184313 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c29b19df-8c0b-4c3a-b7ef-1963d9b9dfc1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:55.195465 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c29b19df-8c0b-4c3a-b7ef-1963d9b9dfc1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:55.195465 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c29b19df-8c0b-4c3a-b7ef-1963d9b9dfc1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:55.195465 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c29b19df-8c0b-4c3a-b7ef-1963d9b9dfc1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:55.195465 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c29b19df-8c0b-4c3a-b7ef-1963d9b9dfc1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:55.554551 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d522ffd2-f6ae-45a3-ace4-61ed308a13b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28079 microversion: 2.20 time: 0.423721 Nov 23 14:31:55.555527 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 132/255] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:55 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28079 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:31:55.560827 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-27662450-9a47-433a-8f7b-f4172b01b0cd tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:55.561915 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-27662450-9a47-433a-8f7b-f4172b01b0cd tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:55.563866 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c29b19df-8c0b-4c3a-b7ef-1963d9b9dfc1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.384544 Nov 23 14:31:55.564539 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 124/256] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:55 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:31:55.570122 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-27662450-9a47-433a-8f7b-f4172b01b0cd tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:55.570561 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-27662450-9a47-433a-8f7b-f4172b01b0cd tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:55.570721 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c52e5656-f8e7-44ce-8128-d5cb2e7943bb tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:55.571353 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-27662450-9a47-433a-8f7b-f4172b01b0cd tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:55.571644 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c52e5656-f8e7-44ce-8128-d5cb2e7943bb tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:55.571771 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-27662450-9a47-433a-8f7b-f4172b01b0cd tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:55.578703 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c52e5656-f8e7-44ce-8128-d5cb2e7943bb tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:55.579154 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c52e5656-f8e7-44ce-8128-d5cb2e7943bb tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:55.579936 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c52e5656-f8e7-44ce-8128-d5cb2e7943bb tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:55.580462 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c52e5656-f8e7-44ce-8128-d5cb2e7943bb tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:55.729873 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-27662450-9a47-433a-8f7b-f4172b01b0cd tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:55.735355 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c52e5656-f8e7-44ce-8128-d5cb2e7943bb tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:55.738134 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-27662450-9a47-433a-8f7b-f4172b01b0cd tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1520 microversion: 2.1 time: 0.181441 Nov 23 14:31:55.738705 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 133/257] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:55 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:55.743231 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-eda7fe70-a571-4ceb-a2e3-5b68a68351a5 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:55.744058 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-eda7fe70-a571-4ceb-a2e3-5b68a68351a5 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:55.748081 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c52e5656-f8e7-44ce-8128-d5cb2e7943bb tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1315 microversion: 2.1 time: 0.181126 Nov 23 14:31:55.748733 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 125/258] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:55 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:55.751219 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-eda7fe70-a571-4ceb-a2e3-5b68a68351a5 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:55.751880 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-eda7fe70-a571-4ceb-a2e3-5b68a68351a5 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:55.753431 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-eda7fe70-a571-4ceb-a2e3-5b68a68351a5 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:55.753865 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-eda7fe70-a571-4ceb-a2e3-5b68a68351a5 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:55.886423 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-eda7fe70-a571-4ceb-a2e3-5b68a68351a5 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:55.893785 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-eda7fe70-a571-4ceb-a2e3-5b68a68351a5 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1504 microversion: 2.1 time: 0.153872 Nov 23 14:31:55.894308 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 134/259] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:55 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:56.210352 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-1e7bfa35-baaa-4294-a5df-bed43df79648 req-c6930485-44c5-4e0a-b61e-c63c3b9b53a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5679ae88-fa1c-4372-ae6c-f947c4a711e1", "name": "network-vif-plugged", "status": "completed", "tag": "11762584-9dd1-40ad-bff7-ec6d4d6dd36a"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:56.212531 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:31:56.212531 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:31:56.220476 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-1e7bfa35-baaa-4294-a5df-bed43df79648 req-c6930485-44c5-4e0a-b61e-c63c3b9b53a5 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:56.221325 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-1e7bfa35-baaa-4294-a5df-bed43df79648 req-c6930485-44c5-4e0a-b61e-c63c3b9b53a5 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:56.233441 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-1e7bfa35-baaa-4294-a5df-bed43df79648 req-c6930485-44c5-4e0a-b61e-c63c3b9b53a5 service nova] Creating event network-vif-plugged:11762584-9dd1-40ad-bff7-ec6d4d6dd36a for instance 5679ae88-fa1c-4372-ae6c-f947c4a711e1 on hv-cinder-80475 Nov 23 14:31:56.239721 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-1e7bfa35-baaa-4294-a5df-bed43df79648 req-c6930485-44c5-4e0a-b61e-c63c3b9b53a5 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032853 Nov 23 14:31:56.240687 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 126/260] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:31:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:31:56.571676 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-68716de0-d715-4816-8713-91dd9135a327 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:56.573787 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-68716de0-d715-4816-8713-91dd9135a327 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:56.577878 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2d75f126-2bc2-42fa-b066-d6f462272ea5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:56.578862 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2d75f126-2bc2-42fa-b066-d6f462272ea5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:56.583058 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-68716de0-d715-4816-8713-91dd9135a327 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:56.584422 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-68716de0-d715-4816-8713-91dd9135a327 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:56.585696 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-68716de0-d715-4816-8713-91dd9135a327 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:56.586880 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-68716de0-d715-4816-8713-91dd9135a327 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:56.588161 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2d75f126-2bc2-42fa-b066-d6f462272ea5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:56.588639 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2d75f126-2bc2-42fa-b066-d6f462272ea5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:56.590038 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2d75f126-2bc2-42fa-b066-d6f462272ea5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:56.590618 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2d75f126-2bc2-42fa-b066-d6f462272ea5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:56.673581 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-68716de0-d715-4816-8713-91dd9135a327 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.109227 Nov 23 14:31:56.675069 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 135/261] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:56 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:31:56.690268 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2d75f126-2bc2-42fa-b066-d6f462272ea5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.117124 Nov 23 14:31:56.695664 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 127/262] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:56 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:31:56.755312 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-4521b6bc-da3e-425a-814d-28cdbf6ac3c3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:56.756003 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-4521b6bc-da3e-425a-814d-28cdbf6ac3c3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:56.763042 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4521b6bc-da3e-425a-814d-28cdbf6ac3c3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:56.763772 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4521b6bc-da3e-425a-814d-28cdbf6ac3c3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:56.764597 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4521b6bc-da3e-425a-814d-28cdbf6ac3c3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:56.765032 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4521b6bc-da3e-425a-814d-28cdbf6ac3c3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:56.775304 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-62f0bc8c-fade-4feb-a6a2-1975ead6e5d0 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:56.777316 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-62f0bc8c-fade-4feb-a6a2-1975ead6e5d0 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:56.787991 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-62f0bc8c-fade-4feb-a6a2-1975ead6e5d0 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:56.788488 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-62f0bc8c-fade-4feb-a6a2-1975ead6e5d0 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:56.789496 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-62f0bc8c-fade-4feb-a6a2-1975ead6e5d0 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:56.789942 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-62f0bc8c-fade-4feb-a6a2-1975ead6e5d0 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:56.932468 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-4521b6bc-da3e-425a-814d-28cdbf6ac3c3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:56.946910 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-4521b6bc-da3e-425a-814d-28cdbf6ac3c3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1500 microversion: 2.1 time: 0.195454 Nov 23 14:31:56.949943 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 136/263] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:56 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1500 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:56.960471 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-34943461-55b0-462c-8fd6-9f8f660fa83f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:56.963097 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-34943461-55b0-462c-8fd6-9f8f660fa83f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:56.972519 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-34943461-55b0-462c-8fd6-9f8f660fa83f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:56.973061 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-34943461-55b0-462c-8fd6-9f8f660fa83f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:56.974144 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-34943461-55b0-462c-8fd6-9f8f660fa83f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:56.974811 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-34943461-55b0-462c-8fd6-9f8f660fa83f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:56.975793 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-62f0bc8c-fade-4feb-a6a2-1975ead6e5d0 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:56.983456 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-62f0bc8c-fade-4feb-a6a2-1975ead6e5d0 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1315 microversion: 2.1 time: 0.216098 Nov 23 14:31:56.993765 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 128/264] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:56 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:56.998938 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b123228f-dcce-4674-8d4f-25a68b9153bc tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:31:56.999703 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b123228f-dcce-4674-8d4f-25a68b9153bc tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:57.006019 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b123228f-dcce-4674-8d4f-25a68b9153bc tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:57.006462 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b123228f-dcce-4674-8d4f-25a68b9153bc tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:57.007412 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b123228f-dcce-4674-8d4f-25a68b9153bc tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:57.007844 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b123228f-dcce-4674-8d4f-25a68b9153bc tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:57.131050 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-34943461-55b0-462c-8fd6-9f8f660fa83f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:57.139147 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-34943461-55b0-462c-8fd6-9f8f660fa83f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1504 microversion: 2.1 time: 0.189996 Nov 23 14:31:57.146562 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 137/265] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:56 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:57.162827 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-b123228f-dcce-4674-8d4f-25a68b9153bc tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:31:57.170158 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b123228f-dcce-4674-8d4f-25a68b9153bc tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1514 microversion: 2.1 time: 0.176077 Nov 23 14:31:57.170778 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 129/266] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:31:56 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:31:57.685880 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-fc34d936-3398-4477-a70f-317bc0bc18b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:57.686989 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-fc34d936-3398-4477-a70f-317bc0bc18b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:57.695629 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fc34d936-3398-4477-a70f-317bc0bc18b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:57.696361 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fc34d936-3398-4477-a70f-317bc0bc18b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:57.697181 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fc34d936-3398-4477-a70f-317bc0bc18b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:57.697684 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fc34d936-3398-4477-a70f-317bc0bc18b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:57.710703 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-189b040a-0773-4f19-b1a5-c7531f8d93f2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:31:57.712024 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-189b040a-0773-4f19-b1a5-c7531f8d93f2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:31:57.725726 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-189b040a-0773-4f19-b1a5-c7531f8d93f2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:57.726420 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-189b040a-0773-4f19-b1a5-c7531f8d93f2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:31:57.729300 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-189b040a-0773-4f19-b1a5-c7531f8d93f2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:31:57.729895 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-189b040a-0773-4f19-b1a5-c7531f8d93f2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:02.329368 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-189b040a-0773-4f19-b1a5-c7531f8d93f2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 4.629410 Nov 23 14:32:02.329982 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 130/267] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:31:57 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 4632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:32:02.335131 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3e0067a5-be87-4e7b-b4c2-c303a7fbed87 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:02.335815 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3e0067a5-be87-4e7b-b4c2-c303a7fbed87 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:02.343370 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3e0067a5-be87-4e7b-b4c2-c303a7fbed87 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:02.343815 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3e0067a5-be87-4e7b-b4c2-c303a7fbed87 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:02.344636 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3e0067a5-be87-4e7b-b4c2-c303a7fbed87 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:02.345063 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3e0067a5-be87-4e7b-b4c2-c303a7fbed87 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:02.365066 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-fc34d936-3398-4477-a70f-317bc0bc18b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 4.682134 Nov 23 14:32:02.369069 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 138/268] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:31:57 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 4685 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:02.371767 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c9600c48-eea2-4843-8012-bd94e3012dc1 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:02.372470 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c9600c48-eea2-4843-8012-bd94e3012dc1 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:02.380539 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c9600c48-eea2-4843-8012-bd94e3012dc1 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:02.381021 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c9600c48-eea2-4843-8012-bd94e3012dc1 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:02.381795 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c9600c48-eea2-4843-8012-bd94e3012dc1 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:02.382220 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c9600c48-eea2-4843-8012-bd94e3012dc1 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:02.489007 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3e0067a5-be87-4e7b-b4c2-c303a7fbed87 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:02.496172 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3e0067a5-be87-4e7b-b4c2-c303a7fbed87 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1315 microversion: 2.1 time: 0.165115 Nov 23 14:32:02.506796 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 131/269] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:02 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:02.559227 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c9600c48-eea2-4843-8012-bd94e3012dc1 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:02.566934 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c9600c48-eea2-4843-8012-bd94e3012dc1 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1504 microversion: 2.1 time: 0.199017 Nov 23 14:32:02.567512 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 139/270] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:02 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:02.611843 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6a6acc8d-dae8-456b-9da3-c7cca3ce7698 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2015870464", "imageRef": "b06b9241-c147-436d-86bb-7c49ad8ef09c", "flavorRef": "452", "networks": [{"uuid": "91c21480-0f27-4f06-9850-471f208e0ee5"}]}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:02.664640 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.network.neutron [None req-6a6acc8d-dae8-456b-9da3-c7cca3ce7698 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] validate_networks() for [('91c21480-0f27-4f06-9850-471f208e0ee5', None, None, None, None, None)] {{(pid=116787) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:32:03.009911 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-97151e22-e68b-4e93-b4af-95b57f4d4dc3 req-afe493bc-cfdc-4f82-b1e1-73bc16ca4a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c149ec46-47c0-4d43-abc6-ee2c901ab9b2", "name": "network-vif-deleted", "tag": "0a48ea27-4a0b-401b-90ef-02b2cb56e046"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:03.010417 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-6a6acc8d-dae8-456b-9da3-c7cca3ce7698 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Flavor limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:32:03.010934 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-6a6acc8d-dae8-456b-9da3-c7cca3ce7698 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Image limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:32:03.011407 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:32:03.011407 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:32:03.011791 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-6a6acc8d-dae8-456b-9da3-c7cca3ce7698 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Flavor pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:32:03.012309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-6a6acc8d-dae8-456b-9da3-c7cca3ce7698 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Image pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:32:03.012751 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-6a6acc8d-dae8-456b-9da3-c7cca3ce7698 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:32:03.018245 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-97151e22-e68b-4e93-b4af-95b57f4d4dc3 req-afe493bc-cfdc-4f82-b1e1-73bc16ca4a9f service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:03.019366 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-97151e22-e68b-4e93-b4af-95b57f4d4dc3 req-afe493bc-cfdc-4f82-b1e1-73bc16ca4a9f service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:03.022389 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a6acc8d-dae8-456b-9da3-c7cca3ce7698 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:03.022843 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a6acc8d-dae8-456b-9da3-c7cca3ce7698 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:03.023682 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a6acc8d-dae8-456b-9da3-c7cca3ce7698 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:03.024120 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a6acc8d-dae8-456b-9da3-c7cca3ce7698 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:03.029423 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-97151e22-e68b-4e93-b4af-95b57f4d4dc3 req-afe493bc-cfdc-4f82-b1e1-73bc16ca4a9f service nova] Creating event network-vif-deleted:0a48ea27-4a0b-401b-90ef-02b2cb56e046 for instance c149ec46-47c0-4d43-abc6-ee2c901ab9b2 on hv-cinder-80475 Nov 23 14:32:03.034557 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-97151e22-e68b-4e93-b4af-95b57f4d4dc3 req-afe493bc-cfdc-4f82-b1e1-73bc16ca4a9f service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027801 Nov 23 14:32:03.035259 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 140/271] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:32:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:32:03.041915 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-6a6acc8d-dae8-456b-9da3-c7cca3ce7698 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Getting quotas for project 368da8317e0d4261811a214a941624dc. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:32:03.045799 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-6a6acc8d-dae8-456b-9da3-c7cca3ce7698 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Getting quotas for user a5f5f781b89d41e091d59e326a5e4db5 and project 368da8317e0d4261811a214a941624dc. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:32:03.057044 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6a6acc8d-dae8-456b-9da3-c7cca3ce7698 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Going to run 1 instances... {{(pid=116787) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:32:03.059450 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6a6acc8d-dae8-456b-9da3-c7cca3ce7698 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b06b9241-c147-436d-86bb-7c49ad8ef09c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:32:03.173463 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6a6acc8d-dae8-456b-9da3-c7cca3ce7698 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675333 Nov 23 14:32:03.174465 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 132/272] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:32:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 14:32:03.185440 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-caa3c58a-38f3-4bba-918a-235a07c24af2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:03.186360 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-caa3c58a-38f3-4bba-918a-235a07c24af2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:03.255357 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-caa3c58a-38f3-4bba-918a-235a07c24af2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:03.270719 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-caa3c58a-38f3-4bba-918a-235a07c24af2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1218 microversion: 2.1 time: 0.081905 Nov 23 14:32:03.270719 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 141/273] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:03 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:03.340973 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-545762d9-4113-4f89-ba4b-18fa93ec9ad1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:03.342082 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-545762d9-4113-4f89-ba4b-18fa93ec9ad1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:03.349366 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-545762d9-4113-4f89-ba4b-18fa93ec9ad1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:03.349810 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-545762d9-4113-4f89-ba4b-18fa93ec9ad1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:03.350590 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-545762d9-4113-4f89-ba4b-18fa93ec9ad1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:03.351020 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-545762d9-4113-4f89-ba4b-18fa93ec9ad1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:03.378790 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1b9dc3ab-d829-4d3d-bfc5-566c59ea8005 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:03.379734 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1b9dc3ab-d829-4d3d-bfc5-566c59ea8005 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:03.388314 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1b9dc3ab-d829-4d3d-bfc5-566c59ea8005 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:03.388817 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1b9dc3ab-d829-4d3d-bfc5-566c59ea8005 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:03.389605 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1b9dc3ab-d829-4d3d-bfc5-566c59ea8005 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:03.390037 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1b9dc3ab-d829-4d3d-bfc5-566c59ea8005 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:03.424901 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-545762d9-4113-4f89-ba4b-18fa93ec9ad1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.087402 Nov 23 14:32:03.426434 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 133/274] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:03 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:03.514839 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7e28137d-e4e4-4452-9ad6-6d2825bc6b2b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:03.515571 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7e28137d-e4e4-4452-9ad6-6d2825bc6b2b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:03.523305 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7e28137d-e4e4-4452-9ad6-6d2825bc6b2b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:03.523784 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7e28137d-e4e4-4452-9ad6-6d2825bc6b2b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:03.524580 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7e28137d-e4e4-4452-9ad6-6d2825bc6b2b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:03.525014 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7e28137d-e4e4-4452-9ad6-6d2825bc6b2b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:03.532717 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1b9dc3ab-d829-4d3d-bfc5-566c59ea8005 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.157484 Nov 23 14:32:03.538064 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 142/275] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:03 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:32:03.584557 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ebed87f9-10c7-4b9d-9a2d-34c6e8126b0f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:03.585366 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ebed87f9-10c7-4b9d-9a2d-34c6e8126b0f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:03.592847 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ebed87f9-10c7-4b9d-9a2d-34c6e8126b0f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:03.593554 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ebed87f9-10c7-4b9d-9a2d-34c6e8126b0f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:03.594800 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ebed87f9-10c7-4b9d-9a2d-34c6e8126b0f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:03.595303 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ebed87f9-10c7-4b9d-9a2d-34c6e8126b0f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:03.630093 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ebed87f9-10c7-4b9d-9a2d-34c6e8126b0f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:03.630447 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ebed87f9-10c7-4b9d-9a2d-34c6e8126b0f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:03.630883 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.objects.instance [None req-ebed87f9-10c7-4b9d-9a2d-34c6e8126b0f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lazy-loading 'fault' on Instance uuid c149ec46-47c0-4d43-abc6-ee2c901ab9b2 {{(pid=116788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:32:03.663676 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7e28137d-e4e4-4452-9ad6-6d2825bc6b2b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:03.671398 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7e28137d-e4e4-4452-9ad6-6d2825bc6b2b tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1315 microversion: 2.1 time: 0.160621 Nov 23 14:32:03.671636 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ebed87f9-10c7-4b9d-9a2d-34c6e8126b0f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:03.672154 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 134/276] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:03 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:03.680122 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ebed87f9-10c7-4b9d-9a2d-34c6e8126b0f tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 200 len: 1303 microversion: 2.1 time: 0.099763 Nov 23 14:32:03.681089 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 143/277] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:03 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:04.281213 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ac3f9605-6e7e-40d9-ae24-a7cebc41ba9a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:04.281862 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ac3f9605-6e7e-40d9-ae24-a7cebc41ba9a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:04.289629 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ac3f9605-6e7e-40d9-ae24-a7cebc41ba9a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:04.290079 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ac3f9605-6e7e-40d9-ae24-a7cebc41ba9a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:04.290862 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ac3f9605-6e7e-40d9-ae24-a7cebc41ba9a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:04.291422 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ac3f9605-6e7e-40d9-ae24-a7cebc41ba9a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:04.358411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ac3f9605-6e7e-40d9-ae24-a7cebc41ba9a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:04.374777 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ac3f9605-6e7e-40d9-ae24-a7cebc41ba9a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1222 microversion: 2.1 time: 0.097241 Nov 23 14:32:04.376092 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 135/278] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:04 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:04.436578 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-cfc19d37-a6e7-448e-9365-3e3dcd22e15a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:04.437400 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-cfc19d37-a6e7-448e-9365-3e3dcd22e15a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:04.444152 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cfc19d37-a6e7-448e-9365-3e3dcd22e15a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:04.453256 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cfc19d37-a6e7-448e-9365-3e3dcd22e15a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:04.453256 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cfc19d37-a6e7-448e-9365-3e3dcd22e15a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:04.453256 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cfc19d37-a6e7-448e-9365-3e3dcd22e15a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:04.510299 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-cfc19d37-a6e7-448e-9365-3e3dcd22e15a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.077245 Nov 23 14:32:04.511192 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 144/279] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:04 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:04.545762 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6d91a584-3b66-46a3-aed8-fc0c1e488b09 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:04.546733 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6d91a584-3b66-46a3-aed8-fc0c1e488b09 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:04.553253 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6d91a584-3b66-46a3-aed8-fc0c1e488b09 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:04.553697 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6d91a584-3b66-46a3-aed8-fc0c1e488b09 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:04.554467 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6d91a584-3b66-46a3-aed8-fc0c1e488b09 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:04.554902 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6d91a584-3b66-46a3-aed8-fc0c1e488b09 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:04.645917 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6d91a584-3b66-46a3-aed8-fc0c1e488b09 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.103673 Nov 23 14:32:04.650101 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 136/280] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:04 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:04.688563 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-726e2d45-bcd5-413f-bb04-4f4e725da08c tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:04.691754 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-726e2d45-bcd5-413f-bb04-4f4e725da08c tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:04.696276 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-726e2d45-bcd5-413f-bb04-4f4e725da08c tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:04.696720 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-726e2d45-bcd5-413f-bb04-4f4e725da08c tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:04.697485 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-726e2d45-bcd5-413f-bb04-4f4e725da08c tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:04.697981 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-726e2d45-bcd5-413f-bb04-4f4e725da08c tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:04.698105 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ef45cf38-f6f3-4db4-834c-d366ea45cd44 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:04.698795 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ef45cf38-f6f3-4db4-834c-d366ea45cd44 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: c149ec46-47c0-4d43-abc6-ee2c901ab9b2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:04.705774 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ef45cf38-f6f3-4db4-834c-d366ea45cd44 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:04.706275 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ef45cf38-f6f3-4db4-834c-d366ea45cd44 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:04.707647 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ef45cf38-f6f3-4db4-834c-d366ea45cd44 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:04.708078 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ef45cf38-f6f3-4db4-834c-d366ea45cd44 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:04.725659 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-ef45cf38-f6f3-4db4-834c-d366ea45cd44 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] HTTP exception thrown: Instance c149ec46-47c0-4d43-abc6-ee2c901ab9b2 could not be found. Nov 23 14:32:04.726552 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ef45cf38-f6f3-4db4-834c-d366ea45cd44 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Returning 404 to user: Instance c149ec46-47c0-4d43-abc6-ee2c901ab9b2 could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:32:04.727538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ef45cf38-f6f3-4db4-834c-d366ea45cd44 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2" status: 404 len: 111 microversion: 2.1 time: 0.033633 Nov 23 14:32:04.728665 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 137/281] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:04 2021] GET /compute/v2.1/servers/c149ec46-47c0-4d43-abc6-ee2c901ab9b2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 14:32:04.828668 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a197e387-d42b-443b-aa99-dcb19125d26c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1777762111", "imageRef": "b06b9241-c147-436d-86bb-7c49ad8ef09c", "flavorRef": "452", "networks": [{"uuid": "27ebbb4f-c920-416e-88ae-b0ddbdad523e"}]}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:04.839103 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-726e2d45-bcd5-413f-bb04-4f4e725da08c tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:04.857714 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-726e2d45-bcd5-413f-bb04-4f4e725da08c tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1464 microversion: 2.1 time: 0.162234 Nov 23 14:32:04.857714 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 145/282] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:04 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1464 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:04.889926 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-218f7502-f95c-49f4-b135-c6b813fe4113 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:04.890416 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-218f7502-f95c-49f4-b135-c6b813fe4113 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:04.897125 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-218f7502-f95c-49f4-b135-c6b813fe4113 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:04.897568 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-218f7502-f95c-49f4-b135-c6b813fe4113 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:04.898340 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-218f7502-f95c-49f4-b135-c6b813fe4113 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:04.898765 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-218f7502-f95c-49f4-b135-c6b813fe4113 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:04.909584 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.network.neutron [None req-a197e387-d42b-443b-aa99-dcb19125d26c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] validate_networks() for [('27ebbb4f-c920-416e-88ae-b0ddbdad523e', None, None, None, None, None)] {{(pid=116787) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:32:04.930043 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-218f7502-f95c-49f4-b135-c6b813fe4113 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Going to try to terminate instance {{(pid=116788) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:32:05.186400 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-218f7502-f95c-49f4-b135-c6b813fe4113 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "DELETE /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 204 len: 0 microversion: 2.1 time: 0.299771 Nov 23 14:32:05.186999 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 146/283] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:32:04 2021] DELETE /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 14:32:05.195796 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e245a63f-0b97-4652-8449-01650e32b0fe tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:05.196445 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e245a63f-0b97-4652-8449-01650e32b0fe tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:05.202746 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e245a63f-0b97-4652-8449-01650e32b0fe tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:05.203193 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e245a63f-0b97-4652-8449-01650e32b0fe tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:05.203972 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e245a63f-0b97-4652-8449-01650e32b0fe tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:05.204437 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e245a63f-0b97-4652-8449-01650e32b0fe tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:05.289671 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-a197e387-d42b-443b-aa99-dcb19125d26c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Flavor limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:32:05.290087 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-a197e387-d42b-443b-aa99-dcb19125d26c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Image limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:32:05.290554 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-a197e387-d42b-443b-aa99-dcb19125d26c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Flavor pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:32:05.290956 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-a197e387-d42b-443b-aa99-dcb19125d26c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Image pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:32:05.291365 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-a197e387-d42b-443b-aa99-dcb19125d26c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:32:05.301157 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a197e387-d42b-443b-aa99-dcb19125d26c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:05.301641 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a197e387-d42b-443b-aa99-dcb19125d26c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:05.303217 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a197e387-d42b-443b-aa99-dcb19125d26c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:05.303799 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a197e387-d42b-443b-aa99-dcb19125d26c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:05.324988 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-a197e387-d42b-443b-aa99-dcb19125d26c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Getting quotas for project 2ebe2cb2394a4a3199c5df49b8793c0d. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:32:05.329128 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-a197e387-d42b-443b-aa99-dcb19125d26c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Getting quotas for user 3d07bdc2fc3343af84a3899c2ad7302b and project 2ebe2cb2394a4a3199c5df49b8793c0d. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:32:05.342047 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a197e387-d42b-443b-aa99-dcb19125d26c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Going to run 1 instances... {{(pid=116787) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:32:05.344418 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a197e387-d42b-443b-aa99-dcb19125d26c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b06b9241-c147-436d-86bb-7c49ad8ef09c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:32:05.379136 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e245a63f-0b97-4652-8449-01650e32b0fe tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:05.388196 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e245a63f-0b97-4652-8449-01650e32b0fe tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1470 microversion: 2.1 time: 0.196316 Nov 23 14:32:05.392400 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 147/284] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:05 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:05.393751 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-aa1c922c-b56d-4f13-b5cf-f5372ee70484 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:05.395723 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-aa1c922c-b56d-4f13-b5cf-f5372ee70484 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:05.401548 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-aa1c922c-b56d-4f13-b5cf-f5372ee70484 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:05.402168 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-aa1c922c-b56d-4f13-b5cf-f5372ee70484 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:05.402971 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-aa1c922c-b56d-4f13-b5cf-f5372ee70484 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:05.404767 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-aa1c922c-b56d-4f13-b5cf-f5372ee70484 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:05.428364 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.objects.instance [None req-aa1c922c-b56d-4f13-b5cf-f5372ee70484 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lazy-loading 'flavor' on Instance uuid 6058aa9c-7bfb-4762-8055-36d2f3e29234 {{(pid=116788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:32:05.500765 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a197e387-d42b-443b-aa99-dcb19125d26c tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675694 Nov 23 14:32:05.503128 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 138/285] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:32:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 14:32:05.509944 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-64f07b74-0cf7-49e7-9355-39644d073b93 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:05.510771 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-64f07b74-0cf7-49e7-9355-39644d073b93 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:05.518117 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-64f07b74-0cf7-49e7-9355-39644d073b93 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:05.518780 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-64f07b74-0cf7-49e7-9355-39644d073b93 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:05.520481 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-64f07b74-0cf7-49e7-9355-39644d073b93 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:05.521069 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-64f07b74-0cf7-49e7-9355-39644d073b93 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:05.595442 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-64f07b74-0cf7-49e7-9355-39644d073b93 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:05.608656 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-64f07b74-0cf7-49e7-9355-39644d073b93 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1278 microversion: 2.1 time: 0.100899 Nov 23 14:32:05.616282 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 139/286] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:05 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1278 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:05.621336 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2cf370cb-a1d9-4bfa-a485-3788449766f0 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:05.621949 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2cf370cb-a1d9-4bfa-a485-3788449766f0 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:05.677685 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2cf370cb-a1d9-4bfa-a485-3788449766f0 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:05.685247 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2cf370cb-a1d9-4bfa-a485-3788449766f0 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1214 microversion: 2.1 time: 0.067662 Nov 23 14:32:05.685996 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 140/287] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:05 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:05.692026 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1a3ec0ca-e73e-4c98-b6d6-b7dea9aa7679 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:05.693212 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1a3ec0ca-e73e-4c98-b6d6-b7dea9aa7679 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:05.701125 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1a3ec0ca-e73e-4c98-b6d6-b7dea9aa7679 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:05.701964 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1a3ec0ca-e73e-4c98-b6d6-b7dea9aa7679 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:05.702978 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1a3ec0ca-e73e-4c98-b6d6-b7dea9aa7679 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:05.703354 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1a3ec0ca-e73e-4c98-b6d6-b7dea9aa7679 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:05.806834 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1a3ec0ca-e73e-4c98-b6d6-b7dea9aa7679 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.118899 Nov 23 14:32:05.807479 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 141/288] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:05 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:05.812308 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b60105cf-6fde-4554-9ecb-a0a924a9ac93 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:05.813292 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b60105cf-6fde-4554-9ecb-a0a924a9ac93 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:05.819380 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b60105cf-6fde-4554-9ecb-a0a924a9ac93 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:05.819829 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b60105cf-6fde-4554-9ecb-a0a924a9ac93 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:05.820627 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b60105cf-6fde-4554-9ecb-a0a924a9ac93 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:05.821063 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b60105cf-6fde-4554-9ecb-a0a924a9ac93 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:05.841317 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-aa1c922c-b56d-4f13-b5cf-f5372ee70484 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "POST /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/action" status: 200 len: 32 microversion: 2.1 time: 0.451343 Nov 23 14:32:05.843066 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 148/289] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:05 2021] POST /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/action => generated 32 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:32:05.853210 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d47d8de8-af47-4bfc-8a16-d31b5e3b52a4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:05.853945 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d47d8de8-af47-4bfc-8a16-d31b5e3b52a4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:05.860260 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d47d8de8-af47-4bfc-8a16-d31b5e3b52a4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:05.860705 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d47d8de8-af47-4bfc-8a16-d31b5e3b52a4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:05.861477 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d47d8de8-af47-4bfc-8a16-d31b5e3b52a4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:05.861908 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d47d8de8-af47-4bfc-8a16-d31b5e3b52a4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:06.120915 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d47d8de8-af47-4bfc-8a16-d31b5e3b52a4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:06.128554 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d47d8de8-af47-4bfc-8a16-d31b5e3b52a4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.279254 Nov 23 14:32:06.129155 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 149/290] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:05 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:06.406703 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-375f789e-c3a5-470c-ba11-9d65d27908dc tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:06.407310 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-375f789e-c3a5-470c-ba11-9d65d27908dc tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:06.414135 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-375f789e-c3a5-470c-ba11-9d65d27908dc tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:06.414655 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-375f789e-c3a5-470c-ba11-9d65d27908dc tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:06.415432 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-375f789e-c3a5-470c-ba11-9d65d27908dc tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:06.415861 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-375f789e-c3a5-470c-ba11-9d65d27908dc tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:06.602660 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-375f789e-c3a5-470c-ba11-9d65d27908dc tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:06.609911 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-375f789e-c3a5-470c-ba11-9d65d27908dc tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1470 microversion: 2.1 time: 0.207135 Nov 23 14:32:06.611394 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 150/291] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:06 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:06.622143 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ecfd7dfc-eb03-43b7-9b9c-c3c8e5198e4e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:06.622738 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ecfd7dfc-eb03-43b7-9b9c-c3c8e5198e4e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:06.628225 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ecfd7dfc-eb03-43b7-9b9c-c3c8e5198e4e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:06.628824 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ecfd7dfc-eb03-43b7-9b9c-c3c8e5198e4e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:06.636100 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ecfd7dfc-eb03-43b7-9b9c-c3c8e5198e4e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:06.636100 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ecfd7dfc-eb03-43b7-9b9c-c3c8e5198e4e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:06.760231 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ecfd7dfc-eb03-43b7-9b9c-c3c8e5198e4e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:06.767388 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ecfd7dfc-eb03-43b7-9b9c-c3c8e5198e4e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1318 microversion: 2.1 time: 0.148527 Nov 23 14:32:06.767884 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 151/292] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:06 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:06.772627 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-63292479-336c-4f6c-afb6-5852f6eef685 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:06.773203 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-63292479-336c-4f6c-afb6-5852f6eef685 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:06.778589 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-63292479-336c-4f6c-afb6-5852f6eef685 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:06.779024 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-63292479-336c-4f6c-afb6-5852f6eef685 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:06.779777 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-63292479-336c-4f6c-afb6-5852f6eef685 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:06.780256 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-63292479-336c-4f6c-afb6-5852f6eef685 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:06.837139 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-63292479-336c-4f6c-afb6-5852f6eef685 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:06.844015 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-63292479-336c-4f6c-afb6-5852f6eef685 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1218 microversion: 2.1 time: 0.075198 Nov 23 14:32:06.844601 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 152/293] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:06 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:06.848847 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e829d3be-d81a-4be5-af74-94e3f5fe2fd5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:06.849780 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e829d3be-d81a-4be5-af74-94e3f5fe2fd5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:06.855088 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e829d3be-d81a-4be5-af74-94e3f5fe2fd5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:06.855524 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e829d3be-d81a-4be5-af74-94e3f5fe2fd5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:06.856308 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e829d3be-d81a-4be5-af74-94e3f5fe2fd5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:06.856736 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e829d3be-d81a-4be5-af74-94e3f5fe2fd5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:10.620306 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b60105cf-6fde-4554-9ecb-a0a924a9ac93 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 4.811335 Nov 23 14:32:10.620967 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 142/294] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:05 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 4813 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:10.625765 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-44ec6b1d-300c-4f0a-bf6d-3eff3ae2b754 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:10.626478 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-44ec6b1d-300c-4f0a-bf6d-3eff3ae2b754 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:10.635411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-44ec6b1d-300c-4f0a-bf6d-3eff3ae2b754 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:10.635846 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-44ec6b1d-300c-4f0a-bf6d-3eff3ae2b754 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:10.636651 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-44ec6b1d-300c-4f0a-bf6d-3eff3ae2b754 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:10.637081 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-44ec6b1d-300c-4f0a-bf6d-3eff3ae2b754 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:10.731770 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e829d3be-d81a-4be5-af74-94e3f5fe2fd5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 3.885958 Nov 23 14:32:10.732436 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 153/295] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:06 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 3887 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:10.737417 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d217ba45-5730-44eb-8d69-16f0da427594 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:10.738257 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d217ba45-5730-44eb-8d69-16f0da427594 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:10.745026 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d217ba45-5730-44eb-8d69-16f0da427594 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:10.745467 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d217ba45-5730-44eb-8d69-16f0da427594 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:10.746238 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d217ba45-5730-44eb-8d69-16f0da427594 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:10.746665 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d217ba45-5730-44eb-8d69-16f0da427594 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:10.772958 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-44ec6b1d-300c-4f0a-bf6d-3eff3ae2b754 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:10.780823 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-44ec6b1d-300c-4f0a-bf6d-3eff3ae2b754 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.158620 Nov 23 14:32:10.781398 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 143/296] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:10 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:10.786210 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-fef510a4-3b70-4a39-b9c9-8220c3da20ef tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:10.786811 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-fef510a4-3b70-4a39-b9c9-8220c3da20ef tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:10.793189 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fef510a4-3b70-4a39-b9c9-8220c3da20ef tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:10.793637 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fef510a4-3b70-4a39-b9c9-8220c3da20ef tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:10.794490 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fef510a4-3b70-4a39-b9c9-8220c3da20ef tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:10.795242 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fef510a4-3b70-4a39-b9c9-8220c3da20ef tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:10.983194 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d217ba45-5730-44eb-8d69-16f0da427594 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:10.993167 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d217ba45-5730-44eb-8d69-16f0da427594 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1470 microversion: 2.1 time: 0.259523 Nov 23 14:32:11.003102 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 154/297] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:10 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1470 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:11.003102 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7ad7db6f-50a2-4ed2-bfc4-54606d7293e9 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:11.003102 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7ad7db6f-50a2-4ed2-bfc4-54606d7293e9 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:11.006738 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ad7db6f-50a2-4ed2-bfc4-54606d7293e9 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:11.007189 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ad7db6f-50a2-4ed2-bfc4-54606d7293e9 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:11.007975 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ad7db6f-50a2-4ed2-bfc4-54606d7293e9 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:11.008472 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ad7db6f-50a2-4ed2-bfc4-54606d7293e9 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:11.033441 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-fef510a4-3b70-4a39-b9c9-8220c3da20ef tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:11.035170 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-fef510a4-3b70-4a39-b9c9-8220c3da20ef tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1318 microversion: 2.1 time: 0.252758 Nov 23 14:32:11.035732 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 144/298] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:10 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:11.044407 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-b66079d7-9c9a-4e82-bd6f-800616b64231 req-9e5a9c51-6c22-4f31-85b1-cb15fa13e2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b4442f-25b2-4695-a16f-17263d9e1710", "tag": "50cd9224-27b2-4dca-bbbc-d56748cb8f48"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:11.045973 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:32:11.045973 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:32:11.069256 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-b66079d7-9c9a-4e82-bd6f-800616b64231 req-9e5a9c51-6c22-4f31-85b1-cb15fa13e2b6 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:11.069762 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-b66079d7-9c9a-4e82-bd6f-800616b64231 req-9e5a9c51-6c22-4f31-85b1-cb15fa13e2b6 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:11.083997 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-b66079d7-9c9a-4e82-bd6f-800616b64231 req-9e5a9c51-6c22-4f31-85b1-cb15fa13e2b6 service nova] Creating event network-changed:50cd9224-27b2-4dca-bbbc-d56748cb8f48 for instance 43b4442f-25b2-4695-a16f-17263d9e1710 on hv-cinder-80475 Nov 23 14:32:11.089345 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-b66079d7-9c9a-4e82-bd6f-800616b64231 req-9e5a9c51-6c22-4f31-85b1-cb15fa13e2b6 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050594 Nov 23 14:32:11.089959 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 145/299] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:32:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:32:11.105818 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7ad7db6f-50a2-4ed2-bfc4-54606d7293e9 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:11.114022 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7ad7db6f-50a2-4ed2-bfc4-54606d7293e9 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1210 microversion: 2.1 time: 0.119308 Nov 23 14:32:11.123475 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 155/300] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:10 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1210 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:11.633651 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4796ec6a-b2a2-464b-9f4e-f9bb0112b0b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:11.634616 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4796ec6a-b2a2-464b-9f4e-f9bb0112b0b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:11.640587 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4796ec6a-b2a2-464b-9f4e-f9bb0112b0b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:11.641030 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4796ec6a-b2a2-464b-9f4e-f9bb0112b0b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:11.641790 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4796ec6a-b2a2-464b-9f4e-f9bb0112b0b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:11.642218 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4796ec6a-b2a2-464b-9f4e-f9bb0112b0b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:11.739459 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4796ec6a-b2a2-464b-9f4e-f9bb0112b0b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.109767 Nov 23 14:32:11.740297 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 146/301] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:11 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:11.743593 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-efeff8f1-5f0a-4a6c-ad45-332dcf7b3a17 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:11.744527 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-efeff8f1-5f0a-4a6c-ad45-332dcf7b3a17 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:11.751011 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-efeff8f1-5f0a-4a6c-ad45-332dcf7b3a17 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:11.751457 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-efeff8f1-5f0a-4a6c-ad45-332dcf7b3a17 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:11.752227 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-efeff8f1-5f0a-4a6c-ad45-332dcf7b3a17 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:11.752715 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-efeff8f1-5f0a-4a6c-ad45-332dcf7b3a17 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:11.803012 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1aa0cf44-3ea9-4329-83b5-edd4371b6cb4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:11.803777 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1aa0cf44-3ea9-4329-83b5-edd4371b6cb4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:11.810143 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1aa0cf44-3ea9-4329-83b5-edd4371b6cb4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:11.810593 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1aa0cf44-3ea9-4329-83b5-edd4371b6cb4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:11.811364 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1aa0cf44-3ea9-4329-83b5-edd4371b6cb4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:11.811799 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1aa0cf44-3ea9-4329-83b5-edd4371b6cb4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:11.855270 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-efeff8f1-5f0a-4a6c-ad45-332dcf7b3a17 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.115328 Nov 23 14:32:11.856215 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 156/302] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:11 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:32:11.943500 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-1aa0cf44-3ea9-4329-83b5-edd4371b6cb4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:11.951516 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1aa0cf44-3ea9-4329-83b5-edd4371b6cb4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.153572 Nov 23 14:32:11.952211 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 147/303] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:11 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:12.010729 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-4f2280a1-ece8-49b9-b89e-a69d98cd4484 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:12.011407 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-4f2280a1-ece8-49b9-b89e-a69d98cd4484 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:12.018082 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4f2280a1-ece8-49b9-b89e-a69d98cd4484 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:12.018523 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4f2280a1-ece8-49b9-b89e-a69d98cd4484 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:12.020041 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4f2280a1-ece8-49b9-b89e-a69d98cd4484 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:12.020503 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4f2280a1-ece8-49b9-b89e-a69d98cd4484 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:12.053060 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e4032b79-edef-4c39-85f0-6cd3bb3d4883 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:12.053696 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e4032b79-edef-4c39-85f0-6cd3bb3d4883 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:12.059487 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e4032b79-edef-4c39-85f0-6cd3bb3d4883 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:12.059937 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e4032b79-edef-4c39-85f0-6cd3bb3d4883 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:12.060743 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e4032b79-edef-4c39-85f0-6cd3bb3d4883 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:12.061178 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e4032b79-edef-4c39-85f0-6cd3bb3d4883 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:12.156950 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-4f2280a1-ece8-49b9-b89e-a69d98cd4484 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:12.164651 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-4f2280a1-ece8-49b9-b89e-a69d98cd4484 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1470 microversion: 2.1 time: 0.157815 Nov 23 14:32:12.165228 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 157/304] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:12 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:12.169605 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-58985f27-0a28-45bc-8ac0-6d5706a21c95 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:12.170198 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-58985f27-0a28-45bc-8ac0-6d5706a21c95 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:12.175978 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-58985f27-0a28-45bc-8ac0-6d5706a21c95 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:12.176456 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-58985f27-0a28-45bc-8ac0-6d5706a21c95 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:12.177226 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-58985f27-0a28-45bc-8ac0-6d5706a21c95 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:12.177656 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-58985f27-0a28-45bc-8ac0-6d5706a21c95 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:12.202420 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e4032b79-edef-4c39-85f0-6cd3bb3d4883 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:12.211028 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e4032b79-edef-4c39-85f0-6cd3bb3d4883 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1318 microversion: 2.1 time: 0.161640 Nov 23 14:32:12.211596 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 148/305] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:12 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:12.238575 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-58985f27-0a28-45bc-8ac0-6d5706a21c95 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:12.245697 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-58985f27-0a28-45bc-8ac0-6d5706a21c95 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1266 microversion: 2.1 time: 0.079362 Nov 23 14:32:12.246256 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 158/306] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:12 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:12.751350 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5822612d-ebb1-49cf-9d2d-5da1ab356f36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:12.752417 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5822612d-ebb1-49cf-9d2d-5da1ab356f36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:12.758865 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5822612d-ebb1-49cf-9d2d-5da1ab356f36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:12.759313 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5822612d-ebb1-49cf-9d2d-5da1ab356f36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:12.760083 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5822612d-ebb1-49cf-9d2d-5da1ab356f36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:12.760545 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5822612d-ebb1-49cf-9d2d-5da1ab356f36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:12.867498 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-cfe1aed6-ff3e-4788-9fd7-c736db96b181 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:12.868442 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-cfe1aed6-ff3e-4788-9fd7-c736db96b181 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:12.874712 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cfe1aed6-ff3e-4788-9fd7-c736db96b181 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:12.875156 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cfe1aed6-ff3e-4788-9fd7-c736db96b181 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:12.875921 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cfe1aed6-ff3e-4788-9fd7-c736db96b181 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:12.876383 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cfe1aed6-ff3e-4788-9fd7-c736db96b181 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:17.621116 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5822612d-ebb1-49cf-9d2d-5da1ab356f36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 4.873756 Nov 23 14:32:17.622253 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 149/307] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:12 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 4876 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:32:17.626400 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-cfe1aed6-ff3e-4788-9fd7-c736db96b181 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 4.763092 Nov 23 14:32:17.628224 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 159/308] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:12 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 4765 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:32:17.630939 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4b55bb82-fb63-42fc-a36a-2d993d776708 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:17.630939 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4b55bb82-fb63-42fc-a36a-2d993d776708 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:17.632615 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6beb6575-6de8-46ea-ae20-06fa1b95acd2 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:17.633520 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6beb6575-6de8-46ea-ae20-06fa1b95acd2 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:17.636062 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4b55bb82-fb63-42fc-a36a-2d993d776708 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:17.636539 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4b55bb82-fb63-42fc-a36a-2d993d776708 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:17.637329 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4b55bb82-fb63-42fc-a36a-2d993d776708 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:17.637765 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4b55bb82-fb63-42fc-a36a-2d993d776708 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:17.640873 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6beb6575-6de8-46ea-ae20-06fa1b95acd2 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:17.641316 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6beb6575-6de8-46ea-ae20-06fa1b95acd2 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:17.642088 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6beb6575-6de8-46ea-ae20-06fa1b95acd2 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:17.642517 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6beb6575-6de8-46ea-ae20-06fa1b95acd2 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:17.778944 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4b55bb82-fb63-42fc-a36a-2d993d776708 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:17.779647 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6beb6575-6de8-46ea-ae20-06fa1b95acd2 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:17.787571 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6beb6575-6de8-46ea-ae20-06fa1b95acd2 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1470 microversion: 2.1 time: 0.159365 Nov 23 14:32:17.787968 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4b55bb82-fb63-42fc-a36a-2d993d776708 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.164641 Nov 23 14:32:17.794882 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 160/309] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:17 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:17.795008 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 150/310] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:17 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:17.795008 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3489706d-f731-44ba-912b-037135afb227 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:17.795008 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3489706d-f731-44ba-912b-037135afb227 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:17.799759 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3489706d-f731-44ba-912b-037135afb227 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:17.800220 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3489706d-f731-44ba-912b-037135afb227 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:17.801544 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3489706d-f731-44ba-912b-037135afb227 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:17.801833 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-20959ec3-9eb5-4e4c-9396-074b26d24d59 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:17.802051 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3489706d-f731-44ba-912b-037135afb227 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:17.802439 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-20959ec3-9eb5-4e4c-9396-074b26d24d59 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:17.808280 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-20959ec3-9eb5-4e4c-9396-074b26d24d59 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:17.808731 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-20959ec3-9eb5-4e4c-9396-074b26d24d59 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:17.809504 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-20959ec3-9eb5-4e4c-9396-074b26d24d59 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:17.809933 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-20959ec3-9eb5-4e4c-9396-074b26d24d59 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:17.861915 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3489706d-f731-44ba-912b-037135afb227 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:17.869714 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3489706d-f731-44ba-912b-037135afb227 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1274 microversion: 2.1 time: 0.079844 Nov 23 14:32:17.870290 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 151/311] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:17 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1274 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:18.008994 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-20959ec3-9eb5-4e4c-9396-074b26d24d59 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:18.016124 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-20959ec3-9eb5-4e4c-9396-074b26d24d59 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1318 microversion: 2.1 time: 0.219385 Nov 23 14:32:18.016724 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 161/312] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:17 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:18.633095 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d1ca6d14-d190-4d45-998d-af9f2be8183d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:18.635250 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d1ca6d14-d190-4d45-998d-af9f2be8183d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:18.640548 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6ea1fe4f-d1ad-4bcb-b0dd-b6e56846f84c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:18.641484 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6ea1fe4f-d1ad-4bcb-b0dd-b6e56846f84c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:18.643636 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d1ca6d14-d190-4d45-998d-af9f2be8183d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:18.644197 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d1ca6d14-d190-4d45-998d-af9f2be8183d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:18.646548 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d1ca6d14-d190-4d45-998d-af9f2be8183d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:18.647197 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d1ca6d14-d190-4d45-998d-af9f2be8183d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:18.650756 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6ea1fe4f-d1ad-4bcb-b0dd-b6e56846f84c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:18.651287 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6ea1fe4f-d1ad-4bcb-b0dd-b6e56846f84c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:18.652483 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6ea1fe4f-d1ad-4bcb-b0dd-b6e56846f84c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:18.653129 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6ea1fe4f-d1ad-4bcb-b0dd-b6e56846f84c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:18.743524 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d1ca6d14-d190-4d45-998d-af9f2be8183d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.114141 Nov 23 14:32:18.744447 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 152/313] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:18 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:18.749692 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-a6f66a33-dff5-41ec-ab00-160be88de7f0 req-0ce68b5e-f962-4df5-8891-f1bd91961b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5679ae88-fa1c-4372-ae6c-f947c4a711e1", "name": "network-vif-deleted", "tag": "11762584-9dd1-40ad-bff7-ec6d4d6dd36a"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:18.751408 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:32:18.751408 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:32:18.751704 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6ea1fe4f-d1ad-4bcb-b0dd-b6e56846f84c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.114628 Nov 23 14:32:18.752358 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 162/314] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:18 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:32:18.759885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-a6f66a33-dff5-41ec-ab00-160be88de7f0 req-0ce68b5e-f962-4df5-8891-f1bd91961b73 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:18.760623 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-a6f66a33-dff5-41ec-ab00-160be88de7f0 req-0ce68b5e-f962-4df5-8891-f1bd91961b73 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:18.773885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-a6f66a33-dff5-41ec-ab00-160be88de7f0 req-0ce68b5e-f962-4df5-8891-f1bd91961b73 service nova] Creating event network-vif-deleted:11762584-9dd1-40ad-bff7-ec6d4d6dd36a for instance 5679ae88-fa1c-4372-ae6c-f947c4a711e1 on hv-cinder-80475 Nov 23 14:32:18.778765 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-a6f66a33-dff5-41ec-ab00-160be88de7f0 req-0ce68b5e-f962-4df5-8891-f1bd91961b73 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032887 Nov 23 14:32:18.779361 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 153/315] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:32:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:32:18.806201 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-66590393-6d64-43bd-9dca-a6087ff9cda1 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:18.814299 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4bb7000b-12d1-48a4-9e5c-420fd16401f4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:18.815101 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4bb7000b-12d1-48a4-9e5c-420fd16401f4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:18.820493 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-66590393-6d64-43bd-9dca-a6087ff9cda1 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:18.827528 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4bb7000b-12d1-48a4-9e5c-420fd16401f4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:18.828228 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4bb7000b-12d1-48a4-9e5c-420fd16401f4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:18.829203 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4bb7000b-12d1-48a4-9e5c-420fd16401f4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:18.829806 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4bb7000b-12d1-48a4-9e5c-420fd16401f4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:18.831007 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-66590393-6d64-43bd-9dca-a6087ff9cda1 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:18.831512 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-66590393-6d64-43bd-9dca-a6087ff9cda1 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:18.833066 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-66590393-6d64-43bd-9dca-a6087ff9cda1 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:18.833563 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-66590393-6d64-43bd-9dca-a6087ff9cda1 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:18.900749 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-66590393-6d64-43bd-9dca-a6087ff9cda1 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7309bf14fa08466a9ebb24f25836b235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4719be271ae49a18146758f634bfe77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:18.908800 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-66590393-6d64-43bd-9dca-a6087ff9cda1 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 200 len: 1428 microversion: 2.1 time: 0.107180 Nov 23 14:32:18.909840 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 163/316] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:18 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 1428 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:18.914675 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-db618689-617c-4fe1-b24b-df0f7b6d38c6 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:18.915216 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-db618689-617c-4fe1-b24b-df0f7b6d38c6 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:18.921894 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-db618689-617c-4fe1-b24b-df0f7b6d38c6 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:18.922340 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-db618689-617c-4fe1-b24b-df0f7b6d38c6 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:18.923266 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-db618689-617c-4fe1-b24b-df0f7b6d38c6 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:18.923896 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-db618689-617c-4fe1-b24b-df0f7b6d38c6 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:18.989910 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4bb7000b-12d1-48a4-9e5c-420fd16401f4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:18.997407 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4bb7000b-12d1-48a4-9e5c-420fd16401f4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.192390 Nov 23 14:32:18.997971 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 154/317] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:18 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:19.037052 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f52d15ca-db68-4a7f-84f5-dad298598b4b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:19.037780 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f52d15ca-db68-4a7f-84f5-dad298598b4b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:19.043914 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f52d15ca-db68-4a7f-84f5-dad298598b4b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:19.044460 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f52d15ca-db68-4a7f-84f5-dad298598b4b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:19.045251 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f52d15ca-db68-4a7f-84f5-dad298598b4b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:19.051320 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f52d15ca-db68-4a7f-84f5-dad298598b4b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:19.137549 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-db618689-617c-4fe1-b24b-df0f7b6d38c6 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:19.148816 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-db618689-617c-4fe1-b24b-df0f7b6d38c6 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1314 microversion: 2.1 time: 0.237642 Nov 23 14:32:19.149316 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 164/318] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:18 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:19.190693 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f52d15ca-db68-4a7f-84f5-dad298598b4b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:19.198118 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f52d15ca-db68-4a7f-84f5-dad298598b4b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1318 microversion: 2.1 time: 0.165430 Nov 23 14:32:19.198718 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 155/319] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:19 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:19.756613 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b881778e-5207-460c-9ee7-b03793167ec0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:19.757636 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b881778e-5207-460c-9ee7-b03793167ec0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:19.763957 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b881778e-5207-460c-9ee7-b03793167ec0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:19.764437 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b881778e-5207-460c-9ee7-b03793167ec0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:19.765233 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b881778e-5207-460c-9ee7-b03793167ec0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:19.765767 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b881778e-5207-460c-9ee7-b03793167ec0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:19.771498 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b292ac3d-bb8b-4cce-968c-9564ee1a5d9e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:19.772846 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b292ac3d-bb8b-4cce-968c-9564ee1a5d9e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:19.779214 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b292ac3d-bb8b-4cce-968c-9564ee1a5d9e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:19.782848 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b292ac3d-bb8b-4cce-968c-9564ee1a5d9e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:19.782848 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b292ac3d-bb8b-4cce-968c-9564ee1a5d9e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:19.782848 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b292ac3d-bb8b-4cce-968c-9564ee1a5d9e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:19.923278 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b881778e-5207-460c-9ee7-b03793167ec0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.171468 Nov 23 14:32:19.924167 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 165/320] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:19 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:19.928361 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b292ac3d-bb8b-4cce-968c-9564ee1a5d9e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.161221 Nov 23 14:32:19.932454 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 156/321] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:19 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:32:19.932591 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-9ce70376-8a91-4217-a34e-f4ded7dd72d0 req-9eff6cbe-cd03-4372-b92f-8fe7b3c10197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c", "tag": "c85a6d3a-c869-40b2-b0e9-5274f94633b1"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:19.932591 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:32:19.932591 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:32:19.934202 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-db1b95ee-4f0c-4eb7-81d7-4dbd97eba967 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:19.934896 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-db1b95ee-4f0c-4eb7-81d7-4dbd97eba967 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] [instance: 5679ae88-fa1c-4372-ae6c-f947c4a711e1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:19.942002 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-db1b95ee-4f0c-4eb7-81d7-4dbd97eba967 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:19.942457 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-db1b95ee-4f0c-4eb7-81d7-4dbd97eba967 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:19.943233 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-db1b95ee-4f0c-4eb7-81d7-4dbd97eba967 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:19.943894 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-db1b95ee-4f0c-4eb7-81d7-4dbd97eba967 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:19.948575 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-9ce70376-8a91-4217-a34e-f4ded7dd72d0 req-9eff6cbe-cd03-4372-b92f-8fe7b3c10197 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:19.949027 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-9ce70376-8a91-4217-a34e-f4ded7dd72d0 req-9eff6cbe-cd03-4372-b92f-8fe7b3c10197 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:19.959245 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-db1b95ee-4f0c-4eb7-81d7-4dbd97eba967 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] HTTP exception thrown: Instance 5679ae88-fa1c-4372-ae6c-f947c4a711e1 could not be found. Nov 23 14:32:19.960206 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-db1b95ee-4f0c-4eb7-81d7-4dbd97eba967 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] Returning 404 to user: Instance 5679ae88-fa1c-4372-ae6c-f947c4a711e1 could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:32:19.961259 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-9ce70376-8a91-4217-a34e-f4ded7dd72d0 req-9eff6cbe-cd03-4372-b92f-8fe7b3c10197 service nova] Creating event network-changed:c85a6d3a-c869-40b2-b0e9-5274f94633b1 for instance 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c on hv-cinder-80475 Nov 23 14:32:19.961461 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-db1b95ee-4f0c-4eb7-81d7-4dbd97eba967 tempest-VolumesNegativeTest-1909307808 tempest-VolumesNegativeTest-1909307808-project] 10.222.0.82 "GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1" status: 404 len: 111 microversion: 2.1 time: 0.031078 Nov 23 14:32:19.962580 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 157/322] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:19 2021] GET /compute/v2.1/servers/5679ae88-fa1c-4372-ae6c-f947c4a711e1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:32:19.977085 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-9ce70376-8a91-4217-a34e-f4ded7dd72d0 req-9eff6cbe-cd03-4372-b92f-8fe7b3c10197 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046173 Nov 23 14:32:19.977085 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 166/323] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:32:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:32:20.014472 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a78b451a-1be8-44a5-b4f8-cf2e0fdde415 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:20.015085 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a78b451a-1be8-44a5-b4f8-cf2e0fdde415 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:20.022351 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a78b451a-1be8-44a5-b4f8-cf2e0fdde415 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:20.022806 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a78b451a-1be8-44a5-b4f8-cf2e0fdde415 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:20.023580 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a78b451a-1be8-44a5-b4f8-cf2e0fdde415 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:20.024250 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a78b451a-1be8-44a5-b4f8-cf2e0fdde415 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:20.173700 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a78b451a-1be8-44a5-b4f8-cf2e0fdde415 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:20.177690 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7ea3dded-5ebf-4f5e-84c3-ea4a85cd648d tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:20.178616 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7ea3dded-5ebf-4f5e-84c3-ea4a85cd648d tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:20.181760 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a78b451a-1be8-44a5-b4f8-cf2e0fdde415 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.170839 Nov 23 14:32:20.183129 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 158/324] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:20 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:20.185745 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ea3dded-5ebf-4f5e-84c3-ea4a85cd648d tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:20.186371 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ea3dded-5ebf-4f5e-84c3-ea4a85cd648d tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:20.187154 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ea3dded-5ebf-4f5e-84c3-ea4a85cd648d tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:20.187868 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ea3dded-5ebf-4f5e-84c3-ea4a85cd648d tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:20.214839 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4e892d95-19bd-42f1-8198-d4454e7089cb tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:20.217138 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4e892d95-19bd-42f1-8198-d4454e7089cb tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:20.224365 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4e892d95-19bd-42f1-8198-d4454e7089cb tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:20.225086 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4e892d95-19bd-42f1-8198-d4454e7089cb tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:20.226049 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4e892d95-19bd-42f1-8198-d4454e7089cb tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:20.226651 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4e892d95-19bd-42f1-8198-d4454e7089cb tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:20.372777 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4e892d95-19bd-42f1-8198-d4454e7089cb tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:20.384112 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4e892d95-19bd-42f1-8198-d4454e7089cb tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1318 microversion: 2.1 time: 0.169751 Nov 23 14:32:20.384112 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 159/325] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:20 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:20.441197 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7ea3dded-5ebf-4f5e-84c3-ea4a85cd648d tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:20.449151 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7ea3dded-5ebf-4f5e-84c3-ea4a85cd648d tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1314 microversion: 2.1 time: 0.276963 Nov 23 14:32:20.449729 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 167/326] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:20 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:20.936341 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7b0d8606-b219-4a8e-a0b8-dd9d9c19d828 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:20.936870 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7b0d8606-b219-4a8e-a0b8-dd9d9c19d828 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:20.940151 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-0791b00d-bf7e-4f3d-b521-64ed3f74f34e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:20.941937 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-0791b00d-bf7e-4f3d-b521-64ed3f74f34e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:20.943306 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7b0d8606-b219-4a8e-a0b8-dd9d9c19d828 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:20.943884 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7b0d8606-b219-4a8e-a0b8-dd9d9c19d828 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:20.944848 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7b0d8606-b219-4a8e-a0b8-dd9d9c19d828 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:20.945357 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7b0d8606-b219-4a8e-a0b8-dd9d9c19d828 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:20.949018 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0791b00d-bf7e-4f3d-b521-64ed3f74f34e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:20.949455 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0791b00d-bf7e-4f3d-b521-64ed3f74f34e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:20.950236 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0791b00d-bf7e-4f3d-b521-64ed3f74f34e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:20.950660 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0791b00d-bf7e-4f3d-b521-64ed3f74f34e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:21.141701 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7b0d8606-b219-4a8e-a0b8-dd9d9c19d828 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.209747 Nov 23 14:32:21.142313 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 160/327] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:20 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:21.172472 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-0791b00d-bf7e-4f3d-b521-64ed3f74f34e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.236327 Nov 23 14:32:21.173833 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 168/328] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:20 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:21.200708 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-fc02a46c-846e-45d8-9123-b4eb231fea53 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:21.201415 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-fc02a46c-846e-45d8-9123-b4eb231fea53 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:21.210059 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc02a46c-846e-45d8-9123-b4eb231fea53 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:21.210512 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc02a46c-846e-45d8-9123-b4eb231fea53 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:21.211484 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc02a46c-846e-45d8-9123-b4eb231fea53 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:21.212093 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc02a46c-846e-45d8-9123-b4eb231fea53 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:21.378273 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-fc02a46c-846e-45d8-9123-b4eb231fea53 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:21.387310 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-fc02a46c-846e-45d8-9123-b4eb231fea53 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.190269 Nov 23 14:32:21.387960 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 161/329] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:21 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:21.400030 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bc28709b-ab59-4c17-81dc-98764f6ddaf1 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:21.401772 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bc28709b-ab59-4c17-81dc-98764f6ddaf1 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:21.408742 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bc28709b-ab59-4c17-81dc-98764f6ddaf1 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:21.409192 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bc28709b-ab59-4c17-81dc-98764f6ddaf1 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:21.410880 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bc28709b-ab59-4c17-81dc-98764f6ddaf1 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:21.411327 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bc28709b-ab59-4c17-81dc-98764f6ddaf1 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:21.468803 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5c093a18-0305-453f-8253-af0999f846cd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:21.469611 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5c093a18-0305-453f-8253-af0999f846cd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:21.477627 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5c093a18-0305-453f-8253-af0999f846cd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:21.478114 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5c093a18-0305-453f-8253-af0999f846cd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:21.480032 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5c093a18-0305-453f-8253-af0999f846cd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:21.480764 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5c093a18-0305-453f-8253-af0999f846cd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:21.596426 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-bc28709b-ab59-4c17-81dc-98764f6ddaf1 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:21.605663 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bc28709b-ab59-4c17-81dc-98764f6ddaf1 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1318 microversion: 2.1 time: 0.210530 Nov 23 14:32:21.608280 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 169/330] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:21 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:21.678044 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5c093a18-0305-453f-8253-af0999f846cd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:21.687881 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5c093a18-0305-453f-8253-af0999f846cd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1314 microversion: 2.1 time: 0.225594 Nov 23 14:32:21.688492 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 162/331] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:21 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:22.153592 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9ae56342-1b10-49b2-b7e3-1889aa8a863d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:22.154575 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9ae56342-1b10-49b2-b7e3-1889aa8a863d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:22.161985 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9ae56342-1b10-49b2-b7e3-1889aa8a863d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:22.162425 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9ae56342-1b10-49b2-b7e3-1889aa8a863d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:22.163390 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9ae56342-1b10-49b2-b7e3-1889aa8a863d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:22.163860 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9ae56342-1b10-49b2-b7e3-1889aa8a863d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:22.185956 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9b37ac33-31fd-4bca-b8ea-e1a65b09bb28 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:22.186969 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9b37ac33-31fd-4bca-b8ea-e1a65b09bb28 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:22.193850 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9b37ac33-31fd-4bca-b8ea-e1a65b09bb28 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:22.194308 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9b37ac33-31fd-4bca-b8ea-e1a65b09bb28 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:22.195108 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9b37ac33-31fd-4bca-b8ea-e1a65b09bb28 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:22.195546 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9b37ac33-31fd-4bca-b8ea-e1a65b09bb28 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:22.244034 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9ae56342-1b10-49b2-b7e3-1889aa8a863d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.091047 Nov 23 14:32:22.244034 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 170/332] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:22 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:22.269414 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9b37ac33-31fd-4bca-b8ea-e1a65b09bb28 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.086825 Nov 23 14:32:22.272443 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 163/333] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:22 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:32:22.405255 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-8042392f-4359-417e-8623-fecee008b073 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:22.405946 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-8042392f-4359-417e-8623-fecee008b073 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:22.413656 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8042392f-4359-417e-8623-fecee008b073 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:22.414109 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8042392f-4359-417e-8623-fecee008b073 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:22.414895 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8042392f-4359-417e-8623-fecee008b073 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:22.415336 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8042392f-4359-417e-8623-fecee008b073 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:22.550363 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-8042392f-4359-417e-8623-fecee008b073 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:22.558108 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-8042392f-4359-417e-8623-fecee008b073 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.156924 Nov 23 14:32:22.558673 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 171/334] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:22 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:22.628405 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-916d3bae-aa57-49ff-8171-83ee4ee0353f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:22.629735 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-916d3bae-aa57-49ff-8171-83ee4ee0353f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:22.637293 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-916d3bae-aa57-49ff-8171-83ee4ee0353f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:22.637752 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-916d3bae-aa57-49ff-8171-83ee4ee0353f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:22.639108 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-916d3bae-aa57-49ff-8171-83ee4ee0353f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:22.639693 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-916d3bae-aa57-49ff-8171-83ee4ee0353f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:22.704881 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b48b230a-006a-4a37-9e66-59d1add98542 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:22.705493 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b48b230a-006a-4a37-9e66-59d1add98542 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:22.714018 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b48b230a-006a-4a37-9e66-59d1add98542 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:22.714712 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b48b230a-006a-4a37-9e66-59d1add98542 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:22.721585 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b48b230a-006a-4a37-9e66-59d1add98542 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:22.721585 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b48b230a-006a-4a37-9e66-59d1add98542 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:22.852032 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-916d3bae-aa57-49ff-8171-83ee4ee0353f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:22.864567 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-916d3bae-aa57-49ff-8171-83ee4ee0353f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1318 microversion: 2.1 time: 0.242183 Nov 23 14:32:22.865882 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 164/335] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:22 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:23.252375 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-80a21fd7-e90e-4339-9716-14f135e57666 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:23.253688 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-b48b230a-006a-4a37-9e66-59d1add98542 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:23.256145 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-80a21fd7-e90e-4339-9716-14f135e57666 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:23.262669 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b48b230a-006a-4a37-9e66-59d1add98542 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1314 microversion: 2.1 time: 0.561409 Nov 23 14:32:23.263037 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-80a21fd7-e90e-4339-9716-14f135e57666 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:23.263484 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-80a21fd7-e90e-4339-9716-14f135e57666 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:23.264101 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 172/336] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:22 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:23.265032 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-80a21fd7-e90e-4339-9716-14f135e57666 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:23.265477 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-80a21fd7-e90e-4339-9716-14f135e57666 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:23.283501 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b4430c21-6e53-45c2-92c4-2c8c03e625d7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:23.284675 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b4430c21-6e53-45c2-92c4-2c8c03e625d7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:23.291042 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b4430c21-6e53-45c2-92c4-2c8c03e625d7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:23.291674 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b4430c21-6e53-45c2-92c4-2c8c03e625d7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:23.292641 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b4430c21-6e53-45c2-92c4-2c8c03e625d7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:23.293172 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b4430c21-6e53-45c2-92c4-2c8c03e625d7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:23.382762 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b4430c21-6e53-45c2-92c4-2c8c03e625d7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.103493 Nov 23 14:32:23.383655 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 173/337] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:23 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:32:23.387419 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-80a21fd7-e90e-4339-9716-14f135e57666 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.137451 Nov 23 14:32:23.387419 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 165/338] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:23 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:32:23.577400 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7a8bb41f-ebbc-41f6-a89c-b37878395a13 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:23.578188 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7a8bb41f-ebbc-41f6-a89c-b37878395a13 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:23.585599 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a8bb41f-ebbc-41f6-a89c-b37878395a13 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:23.586043 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a8bb41f-ebbc-41f6-a89c-b37878395a13 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:23.586825 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a8bb41f-ebbc-41f6-a89c-b37878395a13 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:23.587386 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a8bb41f-ebbc-41f6-a89c-b37878395a13 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:23.731745 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7a8bb41f-ebbc-41f6-a89c-b37878395a13 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:23.740879 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7a8bb41f-ebbc-41f6-a89c-b37878395a13 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.167591 Nov 23 14:32:23.743379 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 166/339] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:23 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:23.883044 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bad91d0b-0e6b-49e6-8420-8dea8e65b69e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:23.883738 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bad91d0b-0e6b-49e6-8420-8dea8e65b69e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:23.891796 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bad91d0b-0e6b-49e6-8420-8dea8e65b69e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:23.892259 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bad91d0b-0e6b-49e6-8420-8dea8e65b69e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:23.893211 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bad91d0b-0e6b-49e6-8420-8dea8e65b69e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:23.893621 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bad91d0b-0e6b-49e6-8420-8dea8e65b69e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:24.038683 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-bad91d0b-0e6b-49e6-8420-8dea8e65b69e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:24.046169 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bad91d0b-0e6b-49e6-8420-8dea8e65b69e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1318 microversion: 2.1 time: 0.168010 Nov 23 14:32:24.046730 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 174/340] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:23 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:24.288385 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-94888409-7d33-4f60-87c1-456be55599fd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:24.288940 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-94888409-7d33-4f60-87c1-456be55599fd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:24.295200 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-94888409-7d33-4f60-87c1-456be55599fd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:24.295648 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-94888409-7d33-4f60-87c1-456be55599fd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:24.296453 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-94888409-7d33-4f60-87c1-456be55599fd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:24.296886 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-94888409-7d33-4f60-87c1-456be55599fd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:24.394145 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-188467a3-bb8c-4027-8af2-3f3bfe52509d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:24.395850 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-188467a3-bb8c-4027-8af2-3f3bfe52509d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:24.403931 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-188467a3-bb8c-4027-8af2-3f3bfe52509d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:24.404106 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-188467a3-bb8c-4027-8af2-3f3bfe52509d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:24.405017 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-188467a3-bb8c-4027-8af2-3f3bfe52509d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:24.406040 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-188467a3-bb8c-4027-8af2-3f3bfe52509d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:24.439193 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-94888409-7d33-4f60-87c1-456be55599fd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:24.447044 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-94888409-7d33-4f60-87c1-456be55599fd tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1314 microversion: 2.1 time: 0.162856 Nov 23 14:32:24.447692 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 167/341] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:24 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:24.452094 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0382a642-5f1d-440b-be8b-1b7f58f2b6f8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:24.455947 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0382a642-5f1d-440b-be8b-1b7f58f2b6f8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:24.459571 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0382a642-5f1d-440b-be8b-1b7f58f2b6f8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:24.463405 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0382a642-5f1d-440b-be8b-1b7f58f2b6f8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:24.464658 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0382a642-5f1d-440b-be8b-1b7f58f2b6f8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:24.465251 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0382a642-5f1d-440b-be8b-1b7f58f2b6f8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:24.481964 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-188467a3-bb8c-4027-8af2-3f3bfe52509d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.091882 Nov 23 14:32:24.483904 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 175/342] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:24 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:32:24.572939 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0382a642-5f1d-440b-be8b-1b7f58f2b6f8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.123652 Nov 23 14:32:24.574181 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 168/343] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:24 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:24.759286 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7d9e8b77-d0c3-4320-8c29-5f256bbab349 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:24.760171 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7d9e8b77-d0c3-4320-8c29-5f256bbab349 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:24.768301 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7d9e8b77-d0c3-4320-8c29-5f256bbab349 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:24.768660 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7d9e8b77-d0c3-4320-8c29-5f256bbab349 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:24.769547 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7d9e8b77-d0c3-4320-8c29-5f256bbab349 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:24.770322 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7d9e8b77-d0c3-4320-8c29-5f256bbab349 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:24.911466 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7d9e8b77-d0c3-4320-8c29-5f256bbab349 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:24.918696 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7d9e8b77-d0c3-4320-8c29-5f256bbab349 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.163532 Nov 23 14:32:24.919266 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 176/344] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:24 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:25.062739 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9fa3d0a4-65e9-4fec-9e04-59af190befdd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:25.063505 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9fa3d0a4-65e9-4fec-9e04-59af190befdd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:25.070448 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9fa3d0a4-65e9-4fec-9e04-59af190befdd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:25.070943 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9fa3d0a4-65e9-4fec-9e04-59af190befdd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:25.071746 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9fa3d0a4-65e9-4fec-9e04-59af190befdd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:25.072179 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9fa3d0a4-65e9-4fec-9e04-59af190befdd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:25.211021 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9fa3d0a4-65e9-4fec-9e04-59af190befdd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:25.218453 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9fa3d0a4-65e9-4fec-9e04-59af190befdd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1318 microversion: 2.1 time: 0.159795 Nov 23 14:32:25.219108 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 169/345] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:25 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:25.463815 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-133cbe93-5139-4fe3-8e81-7064084672ba tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:25.464513 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-133cbe93-5139-4fe3-8e81-7064084672ba tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:25.470921 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-133cbe93-5139-4fe3-8e81-7064084672ba tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:25.471366 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-133cbe93-5139-4fe3-8e81-7064084672ba tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:25.472139 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-133cbe93-5139-4fe3-8e81-7064084672ba tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:25.474093 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-133cbe93-5139-4fe3-8e81-7064084672ba tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:25.494313 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-05217110-a627-4de8-8c8b-2e87a673707e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:25.495940 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-05217110-a627-4de8-8c8b-2e87a673707e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:25.503691 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-05217110-a627-4de8-8c8b-2e87a673707e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:25.506002 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-05217110-a627-4de8-8c8b-2e87a673707e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:25.508220 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-05217110-a627-4de8-8c8b-2e87a673707e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:25.508928 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-05217110-a627-4de8-8c8b-2e87a673707e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:25.668338 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-133cbe93-5139-4fe3-8e81-7064084672ba tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:25.680794 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-133cbe93-5139-4fe3-8e81-7064084672ba tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1314 microversion: 2.1 time: 0.215831 Nov 23 14:32:25.682951 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-05217110-a627-4de8-8c8b-2e87a673707e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.191647 Nov 23 14:32:25.684313 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 170/346] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:25 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:25.687343 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 177/347] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:25 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:25.690636 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-022046cd-5096-4ceb-91f6-ec0f0d938731 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:25.692513 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-022046cd-5096-4ceb-91f6-ec0f0d938731 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:25.700826 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-022046cd-5096-4ceb-91f6-ec0f0d938731 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:25.701273 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-022046cd-5096-4ceb-91f6-ec0f0d938731 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:25.702256 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-022046cd-5096-4ceb-91f6-ec0f0d938731 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:25.702876 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-022046cd-5096-4ceb-91f6-ec0f0d938731 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:25.783837 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-022046cd-5096-4ceb-91f6-ec0f0d938731 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.097848 Nov 23 14:32:25.784387 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 171/348] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:25 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:25.935907 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7803e187-3dfc-453e-9b4f-f309d992ccb8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:25.936596 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7803e187-3dfc-453e-9b4f-f309d992ccb8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:25.943654 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7803e187-3dfc-453e-9b4f-f309d992ccb8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:25.944192 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7803e187-3dfc-453e-9b4f-f309d992ccb8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:25.944994 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7803e187-3dfc-453e-9b4f-f309d992ccb8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:25.945431 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7803e187-3dfc-453e-9b4f-f309d992ccb8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:26.086472 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7803e187-3dfc-453e-9b4f-f309d992ccb8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:26.097169 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7803e187-3dfc-453e-9b4f-f309d992ccb8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.164826 Nov 23 14:32:26.098942 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 178/349] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:25 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:26.236226 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7c17c057-c336-4df8-940b-22f693ab48a1 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:26.237217 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7c17c057-c336-4df8-940b-22f693ab48a1 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:26.244696 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7c17c057-c336-4df8-940b-22f693ab48a1 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:26.245144 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7c17c057-c336-4df8-940b-22f693ab48a1 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:26.246021 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7c17c057-c336-4df8-940b-22f693ab48a1 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:26.246632 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7c17c057-c336-4df8-940b-22f693ab48a1 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:26.383966 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7c17c057-c336-4df8-940b-22f693ab48a1 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:26.391165 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7c17c057-c336-4df8-940b-22f693ab48a1 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1318 microversion: 2.1 time: 0.159162 Nov 23 14:32:26.391717 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 172/350] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:26 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:26.694919 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-95f97aca-04ee-41ee-883e-6099cec56f36 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:26.695681 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-95f97aca-04ee-41ee-883e-6099cec56f36 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:26.702400 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-95f97aca-04ee-41ee-883e-6099cec56f36 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:26.703092 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-95f97aca-04ee-41ee-883e-6099cec56f36 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:26.703266 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-bc0fbe69-0b46-4bfa-9a08-432d57157292 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:26.703938 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-95f97aca-04ee-41ee-883e-6099cec56f36 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:26.704080 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-bc0fbe69-0b46-4bfa-9a08-432d57157292 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:26.704298 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-95f97aca-04ee-41ee-883e-6099cec56f36 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:26.710841 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bc0fbe69-0b46-4bfa-9a08-432d57157292 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:26.711499 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bc0fbe69-0b46-4bfa-9a08-432d57157292 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:26.712384 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bc0fbe69-0b46-4bfa-9a08-432d57157292 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:26.712972 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bc0fbe69-0b46-4bfa-9a08-432d57157292 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:26.793104 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-bc0fbe69-0b46-4bfa-9a08-432d57157292 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.093264 Nov 23 14:32:26.794897 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 173/351] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:26 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:26.806432 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4e74c3a4-1d97-414b-876c-640c66387e80 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:26.807423 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4e74c3a4-1d97-414b-876c-640c66387e80 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:26.825654 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4e74c3a4-1d97-414b-876c-640c66387e80 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:26.826106 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4e74c3a4-1d97-414b-876c-640c66387e80 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:26.827117 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4e74c3a4-1d97-414b-876c-640c66387e80 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:26.827701 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4e74c3a4-1d97-414b-876c-640c66387e80 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:26.907896 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4e74c3a4-1d97-414b-876c-640c66387e80 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.110364 Nov 23 14:32:26.908476 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 174/352] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:26 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:26.915650 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-929ada14-24bc-42f3-96a1-c734cc45c1c9 req-944d640c-7008-4c8e-ac81-fcd2cf903e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b4442f-25b2-4695-a16f-17263d9e1710", "name": "network-vif-plugged", "status": "completed", "tag": "50cd9224-27b2-4dca-bbbc-d56748cb8f48"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:26.917622 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:32:26.917622 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:32:26.928085 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-929ada14-24bc-42f3-96a1-c734cc45c1c9 req-944d640c-7008-4c8e-ac81-fcd2cf903e83 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:26.928794 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-929ada14-24bc-42f3-96a1-c734cc45c1c9 req-944d640c-7008-4c8e-ac81-fcd2cf903e83 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:26.941244 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-929ada14-24bc-42f3-96a1-c734cc45c1c9 req-944d640c-7008-4c8e-ac81-fcd2cf903e83 service nova] Creating event network-vif-plugged:50cd9224-27b2-4dca-bbbc-d56748cb8f48 for instance 43b4442f-25b2-4695-a16f-17263d9e1710 on hv-cinder-80475 Nov 23 14:32:26.947378 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-929ada14-24bc-42f3-96a1-c734cc45c1c9 req-944d640c-7008-4c8e-ac81-fcd2cf903e83 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037429 Nov 23 14:32:26.948659 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 175/353] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:32:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:32:27.042830 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-95f97aca-04ee-41ee-883e-6099cec56f36 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:27.054046 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-95f97aca-04ee-41ee-883e-6099cec56f36 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1314 microversion: 2.1 time: 0.363939 Nov 23 14:32:27.064413 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 179/354] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:26 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:27.119823 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-796f86ab-e37e-48ef-8fbf-9194749794f9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:27.120562 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-796f86ab-e37e-48ef-8fbf-9194749794f9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:27.126668 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-796f86ab-e37e-48ef-8fbf-9194749794f9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:27.127118 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-796f86ab-e37e-48ef-8fbf-9194749794f9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:27.128027 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-796f86ab-e37e-48ef-8fbf-9194749794f9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:27.129429 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-796f86ab-e37e-48ef-8fbf-9194749794f9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:27.349894 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-796f86ab-e37e-48ef-8fbf-9194749794f9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:27.357834 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-796f86ab-e37e-48ef-8fbf-9194749794f9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1500 microversion: 2.1 time: 0.243936 Nov 23 14:32:27.358513 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 176/355] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:27 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1500 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:27.375580 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-807c5c78-f466-4eb1-a345-6b76a54a6dac tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5185ca46-db8d-4ff6-bc63-461296bf2698"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:27.376726 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-807c5c78-f466-4eb1-a345-6b76a54a6dac tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:27.383386 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-807c5c78-f466-4eb1-a345-6b76a54a6dac tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:27.384035 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-807c5c78-f466-4eb1-a345-6b76a54a6dac tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:27.385108 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-807c5c78-f466-4eb1-a345-6b76a54a6dac tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:27.386162 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-807c5c78-f466-4eb1-a345-6b76a54a6dac tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:27.409203 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0fa350d5-a075-40a7-999a-8aeace3175d0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:27.411058 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0fa350d5-a075-40a7-999a-8aeace3175d0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:27.411968 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-807c5c78-f466-4eb1-a345-6b76a54a6dac tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] HTTP exception thrown: Cannot 'attach_volume' instance 6058aa9c-7bfb-4762-8055-36d2f3e29234 while it is in vm_state rescued Nov 23 14:32:27.412587 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-807c5c78-f466-4eb1-a345-6b76a54a6dac tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Returning 409 to user: Cannot 'attach_volume' instance 6058aa9c-7bfb-4762-8055-36d2f3e29234 while it is in vm_state rescued {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:32:27.413407 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-807c5c78-f466-4eb1-a345-6b76a54a6dac tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "POST /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041727 Nov 23 14:32:27.414316 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 180/356] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Nov 23 14:32:27 2021] POST /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 23 14:32:27.423245 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0fa350d5-a075-40a7-999a-8aeace3175d0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:27.424065 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-396999e2-ccf1-41a6-a88d-fa35c3047595 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:27.424572 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0fa350d5-a075-40a7-999a-8aeace3175d0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:27.424704 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-396999e2-ccf1-41a6-a88d-fa35c3047595 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:27.425746 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0fa350d5-a075-40a7-999a-8aeace3175d0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:27.427393 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0fa350d5-a075-40a7-999a-8aeace3175d0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:27.431734 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-396999e2-ccf1-41a6-a88d-fa35c3047595 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:27.432189 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-396999e2-ccf1-41a6-a88d-fa35c3047595 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:27.433186 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-396999e2-ccf1-41a6-a88d-fa35c3047595 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:27.433784 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-396999e2-ccf1-41a6-a88d-fa35c3047595 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:27.605918 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0fa350d5-a075-40a7-999a-8aeace3175d0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:27.615447 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0fa350d5-a075-40a7-999a-8aeace3175d0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1318 microversion: 2.1 time: 0.210075 Nov 23 14:32:27.616062 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 177/357] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:27 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:27.662968 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-396999e2-ccf1-41a6-a88d-fa35c3047595 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "POST /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/action" status: 202 len: 0 microversion: 2.1 time: 0.242962 Nov 23 14:32:27.663779 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 181/358] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:27 2021] POST /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:27.672214 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3fe782b0-9df5-45ae-a532-3d43a5f1247b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:27.674193 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3fe782b0-9df5-45ae-a532-3d43a5f1247b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:27.681047 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3fe782b0-9df5-45ae-a532-3d43a5f1247b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:27.681548 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3fe782b0-9df5-45ae-a532-3d43a5f1247b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:27.682335 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3fe782b0-9df5-45ae-a532-3d43a5f1247b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:27.682984 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3fe782b0-9df5-45ae-a532-3d43a5f1247b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:27.808990 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f139222b-d041-4868-9abd-f3fa9d932e44 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:27.810226 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f139222b-d041-4868-9abd-f3fa9d932e44 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:27.816221 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f139222b-d041-4868-9abd-f3fa9d932e44 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:27.817540 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f139222b-d041-4868-9abd-f3fa9d932e44 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:27.818710 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f139222b-d041-4868-9abd-f3fa9d932e44 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:27.819294 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f139222b-d041-4868-9abd-f3fa9d932e44 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:27.830704 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3fe782b0-9df5-45ae-a532-3d43a5f1247b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:27.839309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3fe782b0-9df5-45ae-a532-3d43a5f1247b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1508 microversion: 2.1 time: 0.171312 Nov 23 14:32:27.844379 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 178/359] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:27 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:27.887904 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f139222b-d041-4868-9abd-f3fa9d932e44 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.083547 Nov 23 14:32:27.888670 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 182/360] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:27 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:32:27.921336 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6c817f20-0b31-4a4b-827e-e60ba76399e3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:27.922416 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6c817f20-0b31-4a4b-827e-e60ba76399e3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:27.929573 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c817f20-0b31-4a4b-827e-e60ba76399e3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:27.930214 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c817f20-0b31-4a4b-827e-e60ba76399e3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:27.931106 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c817f20-0b31-4a4b-827e-e60ba76399e3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:27.931646 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c817f20-0b31-4a4b-827e-e60ba76399e3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:28.050459 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6c817f20-0b31-4a4b-827e-e60ba76399e3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.133432 Nov 23 14:32:28.051652 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 179/361] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:27 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:32:28.075926 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e8d22de8-3299-4151-8763-9876ba46b477 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:28.077221 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e8d22de8-3299-4151-8763-9876ba46b477 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:28.085621 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e8d22de8-3299-4151-8763-9876ba46b477 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:28.086259 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e8d22de8-3299-4151-8763-9876ba46b477 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:28.087310 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e8d22de8-3299-4151-8763-9876ba46b477 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:28.087895 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e8d22de8-3299-4151-8763-9876ba46b477 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:28.376939 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e8d22de8-3299-4151-8763-9876ba46b477 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:28.406830 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e8d22de8-3299-4151-8763-9876ba46b477 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1314 microversion: 2.1 time: 0.338738 Nov 23 14:32:28.407398 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 183/362] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:28 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:28.635188 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8cd19c36-cf0d-4d99-8204-60f6d1b1a3cb tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:28.635920 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8cd19c36-cf0d-4d99-8204-60f6d1b1a3cb tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:28.641957 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8cd19c36-cf0d-4d99-8204-60f6d1b1a3cb tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:28.642975 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8cd19c36-cf0d-4d99-8204-60f6d1b1a3cb tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:28.643257 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8cd19c36-cf0d-4d99-8204-60f6d1b1a3cb tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:28.643691 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8cd19c36-cf0d-4d99-8204-60f6d1b1a3cb tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:28.844987 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-8cd19c36-cf0d-4d99-8204-60f6d1b1a3cb tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:28.852906 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8cd19c36-cf0d-4d99-8204-60f6d1b1a3cb tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1318 microversion: 2.1 time: 0.221595 Nov 23 14:32:28.860221 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-2bbea4c6-4a5f-41bf-8f4b-acd78cdb8df3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:28.860878 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-2bbea4c6-4a5f-41bf-8f4b-acd78cdb8df3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:28.862380 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 180/363] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:28 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:28.868181 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2bbea4c6-4a5f-41bf-8f4b-acd78cdb8df3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:28.868794 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2bbea4c6-4a5f-41bf-8f4b-acd78cdb8df3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:28.869745 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2bbea4c6-4a5f-41bf-8f4b-acd78cdb8df3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:28.870335 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2bbea4c6-4a5f-41bf-8f4b-acd78cdb8df3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:28.902080 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-fcc94e69-08bb-404c-81cb-6372a4f91c0a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:28.903300 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-fcc94e69-08bb-404c-81cb-6372a4f91c0a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:28.918025 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fcc94e69-08bb-404c-81cb-6372a4f91c0a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:28.919493 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fcc94e69-08bb-404c-81cb-6372a4f91c0a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:28.920411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fcc94e69-08bb-404c-81cb-6372a4f91c0a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:28.920848 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fcc94e69-08bb-404c-81cb-6372a4f91c0a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:29.025963 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-fcc94e69-08bb-404c-81cb-6372a4f91c0a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.127481 Nov 23 14:32:29.027468 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 181/364] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:28 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:32:29.042087 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-051fdeb5-cee8-412b-8ceb-caa0b35aa654 req-20effd56-0e79-49f3-b425-aff267388b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c", "name": "network-vif-plugged", "status": "completed", "tag": "c85a6d3a-c869-40b2-b0e9-5274f94633b1"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:29.046576 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:32:29.046576 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:32:29.056189 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-051fdeb5-cee8-412b-8ceb-caa0b35aa654 req-20effd56-0e79-49f3-b425-aff267388b07 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:29.057160 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-051fdeb5-cee8-412b-8ceb-caa0b35aa654 req-20effd56-0e79-49f3-b425-aff267388b07 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:29.092304 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-051fdeb5-cee8-412b-8ceb-caa0b35aa654 req-20effd56-0e79-49f3-b425-aff267388b07 service nova] Creating event network-vif-plugged:c85a6d3a-c869-40b2-b0e9-5274f94633b1 for instance 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c on hv-cinder-80475 Nov 23 14:32:29.098781 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-051fdeb5-cee8-412b-8ceb-caa0b35aa654 req-20effd56-0e79-49f3-b425-aff267388b07 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068964 Nov 23 14:32:29.099375 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 182/365] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:32:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:32:29.104636 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6c2d2321-8e68-42e1-aeb9-214e5b6ca355 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:29.106438 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6c2d2321-8e68-42e1-aeb9-214e5b6ca355 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:29.114801 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c2d2321-8e68-42e1-aeb9-214e5b6ca355 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:29.115258 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c2d2321-8e68-42e1-aeb9-214e5b6ca355 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:29.116046 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c2d2321-8e68-42e1-aeb9-214e5b6ca355 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:29.116719 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c2d2321-8e68-42e1-aeb9-214e5b6ca355 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:29.213199 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6c2d2321-8e68-42e1-aeb9-214e5b6ca355 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.112264 Nov 23 14:32:29.214383 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 183/366] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:29 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:29.249878 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-2bbea4c6-4a5f-41bf-8f4b-acd78cdb8df3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:29.261674 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-2bbea4c6-4a5f-41bf-8f4b-acd78cdb8df3 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1508 microversion: 2.1 time: 0.401743 Nov 23 14:32:29.261674 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 184/367] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:28 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1508 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:29.424941 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7ccc5b01-ec5e-4da9-923f-a19fcc52b178 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:29.425850 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7ccc5b01-ec5e-4da9-923f-a19fcc52b178 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:29.436270 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7ccc5b01-ec5e-4da9-923f-a19fcc52b178 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:29.437071 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7ccc5b01-ec5e-4da9-923f-a19fcc52b178 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:29.438029 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7ccc5b01-ec5e-4da9-923f-a19fcc52b178 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:29.438608 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7ccc5b01-ec5e-4da9-923f-a19fcc52b178 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:29.595127 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7ccc5b01-ec5e-4da9-923f-a19fcc52b178 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:29.603309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7ccc5b01-ec5e-4da9-923f-a19fcc52b178 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1314 microversion: 2.1 time: 0.182306 Nov 23 14:32:29.603873 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 184/368] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:29 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:29.869411 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e70749fd-a6a7-4640-a8d3-5b2a6995d5ed tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:29.870094 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e70749fd-a6a7-4640-a8d3-5b2a6995d5ed tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:29.876457 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e70749fd-a6a7-4640-a8d3-5b2a6995d5ed tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:29.876985 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e70749fd-a6a7-4640-a8d3-5b2a6995d5ed tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:29.877833 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e70749fd-a6a7-4640-a8d3-5b2a6995d5ed tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:29.878466 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e70749fd-a6a7-4640-a8d3-5b2a6995d5ed tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:30.028116 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e70749fd-a6a7-4640-a8d3-5b2a6995d5ed tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:30.038918 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e70749fd-a6a7-4640-a8d3-5b2a6995d5ed tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1508 microversion: 2.1 time: 0.173092 Nov 23 14:32:30.050345 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f06ce001-5b4f-4753-bc7d-cc5b5a6684ef tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:30.050831 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 185/369] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:29 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:30.050980 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f06ce001-5b4f-4753-bc7d-cc5b5a6684ef tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:30.050980 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f06ce001-5b4f-4753-bc7d-cc5b5a6684ef tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:30.050980 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f06ce001-5b4f-4753-bc7d-cc5b5a6684ef tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:30.050980 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f06ce001-5b4f-4753-bc7d-cc5b5a6684ef tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:30.051548 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f06ce001-5b4f-4753-bc7d-cc5b5a6684ef tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:30.183420 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f06ce001-5b4f-4753-bc7d-cc5b5a6684ef tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28130 microversion: 2.1 time: 0.149392 Nov 23 14:32:30.184335 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 185/370] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:30 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28130 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:30.226592 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3cdf17c4-d09c-402e-abb8-2ac907ca1d12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:30.227863 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3cdf17c4-d09c-402e-abb8-2ac907ca1d12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:30.237164 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3cdf17c4-d09c-402e-abb8-2ac907ca1d12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:30.237891 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3cdf17c4-d09c-402e-abb8-2ac907ca1d12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:30.239636 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3cdf17c4-d09c-402e-abb8-2ac907ca1d12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:30.240387 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3cdf17c4-d09c-402e-abb8-2ac907ca1d12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:30.278454 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d050b2a4-37f6-4e75-89e5-573c151d7de7 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:30.279601 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d050b2a4-37f6-4e75-89e5-573c151d7de7 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:30.287135 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d050b2a4-37f6-4e75-89e5-573c151d7de7 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:30.287583 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d050b2a4-37f6-4e75-89e5-573c151d7de7 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:30.288404 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d050b2a4-37f6-4e75-89e5-573c151d7de7 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:30.289011 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d050b2a4-37f6-4e75-89e5-573c151d7de7 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:30.361076 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3cdf17c4-d09c-402e-abb8-2ac907ca1d12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.138687 Nov 23 14:32:30.362431 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 186/371] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:30 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:30.620876 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-dece9235-b095-4921-bae2-df8bb9220827 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:30.621806 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-dece9235-b095-4921-bae2-df8bb9220827 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:30.628858 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dece9235-b095-4921-bae2-df8bb9220827 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:30.629413 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dece9235-b095-4921-bae2-df8bb9220827 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:30.633984 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dece9235-b095-4921-bae2-df8bb9220827 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:30.633984 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dece9235-b095-4921-bae2-df8bb9220827 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:30.687627 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d050b2a4-37f6-4e75-89e5-573c151d7de7 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:30.696673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d050b2a4-37f6-4e75-89e5-573c151d7de7 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1508 microversion: 2.1 time: 0.422378 Nov 23 14:32:30.697513 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 186/372] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:30 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1508 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:30.797129 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-dece9235-b095-4921-bae2-df8bb9220827 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:30.805502 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-dece9235-b095-4921-bae2-df8bb9220827 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1314 microversion: 2.1 time: 0.188535 Nov 23 14:32:30.806077 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 187/373] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:30 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:31.195649 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2ab4d53b-32ab-46cb-a47e-43bd26ed0269 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:31.196593 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2ab4d53b-32ab-46cb-a47e-43bd26ed0269 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:31.202722 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2ab4d53b-32ab-46cb-a47e-43bd26ed0269 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:31.203188 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2ab4d53b-32ab-46cb-a47e-43bd26ed0269 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:31.203948 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2ab4d53b-32ab-46cb-a47e-43bd26ed0269 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:31.204424 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2ab4d53b-32ab-46cb-a47e-43bd26ed0269 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:31.349965 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2ab4d53b-32ab-46cb-a47e-43bd26ed0269 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28155 microversion: 2.1 time: 0.158340 Nov 23 14:32:31.350607 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 187/374] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:31 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28155 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:31.377585 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-97689baf-3568-48b0-a2fd-94831d0c9bcf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:31.378495 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-97689baf-3568-48b0-a2fd-94831d0c9bcf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:31.385522 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-97689baf-3568-48b0-a2fd-94831d0c9bcf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:31.388782 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-97689baf-3568-48b0-a2fd-94831d0c9bcf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:31.388782 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-97689baf-3568-48b0-a2fd-94831d0c9bcf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:31.388782 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-97689baf-3568-48b0-a2fd-94831d0c9bcf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:31.505433 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-97689baf-3568-48b0-a2fd-94831d0c9bcf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.133493 Nov 23 14:32:31.509595 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 188/375] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:31 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:31.714809 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b3586002-3cf3-41ab-8171-658822345948 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:31.715500 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b3586002-3cf3-41ab-8171-658822345948 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:31.723520 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b3586002-3cf3-41ab-8171-658822345948 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:31.724165 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b3586002-3cf3-41ab-8171-658822345948 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:31.725003 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b3586002-3cf3-41ab-8171-658822345948 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:31.725440 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b3586002-3cf3-41ab-8171-658822345948 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:31.822263 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-2475df66-5a41-4aea-97d7-716742e9c074 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:31.822963 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-2475df66-5a41-4aea-97d7-716742e9c074 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:31.829230 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2475df66-5a41-4aea-97d7-716742e9c074 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:31.829680 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2475df66-5a41-4aea-97d7-716742e9c074 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:31.830517 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2475df66-5a41-4aea-97d7-716742e9c074 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:31.830953 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2475df66-5a41-4aea-97d7-716742e9c074 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:31.871987 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-b3586002-3cf3-41ab-8171-658822345948 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:31.881904 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b3586002-3cf3-41ab-8171-658822345948 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1508 microversion: 2.1 time: 0.171109 Nov 23 14:32:31.882907 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 188/376] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:31 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:32.030685 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-2475df66-5a41-4aea-97d7-716742e9c074 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:32.038838 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-2475df66-5a41-4aea-97d7-716742e9c074 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1498 microversion: 2.1 time: 0.220462 Nov 23 14:32:32.039449 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 189/377] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:31 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1498 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:32.361989 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5138adfe-905d-4f38-b64a-7acfa0ab1373 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:32.362846 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5138adfe-905d-4f38-b64a-7acfa0ab1373 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:32.369595 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5138adfe-905d-4f38-b64a-7acfa0ab1373 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:32.370043 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5138adfe-905d-4f38-b64a-7acfa0ab1373 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:32.370832 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5138adfe-905d-4f38-b64a-7acfa0ab1373 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:32.371271 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5138adfe-905d-4f38-b64a-7acfa0ab1373 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:32.480108 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5138adfe-905d-4f38-b64a-7acfa0ab1373 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28421 microversion: 2.1 time: 0.121833 Nov 23 14:32:32.480794 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 189/378] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:32 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28421 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:32.517207 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3f686ca3-5cfc-468b-b2f8-02e02f77de9a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:32.517683 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3f686ca3-5cfc-468b-b2f8-02e02f77de9a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:32.523962 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3f686ca3-5cfc-468b-b2f8-02e02f77de9a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:32.524438 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3f686ca3-5cfc-468b-b2f8-02e02f77de9a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:32.525210 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3f686ca3-5cfc-468b-b2f8-02e02f77de9a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:32.525638 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3f686ca3-5cfc-468b-b2f8-02e02f77de9a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:32.596398 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3f686ca3-5cfc-468b-b2f8-02e02f77de9a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28196 microversion: 2.20 time: 0.082587 Nov 23 14:32:32.604124 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 190/379] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:32 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28196 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:32.899138 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0173faf1-5c3c-4440-aece-7a6830d8dbf5 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:32.899780 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0173faf1-5c3c-4440-aece-7a6830d8dbf5 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:32.906565 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0173faf1-5c3c-4440-aece-7a6830d8dbf5 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:32.907013 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0173faf1-5c3c-4440-aece-7a6830d8dbf5 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:32.907794 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0173faf1-5c3c-4440-aece-7a6830d8dbf5 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:32.908227 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0173faf1-5c3c-4440-aece-7a6830d8dbf5 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:33.001235 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bf06b190-d9a3-41cc-834e-cfd319583c05 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e85d5fc-6b47-4431-bef4-9706cfb15849"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:33.002362 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bf06b190-d9a3-41cc-834e-cfd319583c05 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:33.010896 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bf06b190-d9a3-41cc-834e-cfd319583c05 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:33.011320 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bf06b190-d9a3-41cc-834e-cfd319583c05 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:33.012108 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bf06b190-d9a3-41cc-834e-cfd319583c05 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:33.012589 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bf06b190-d9a3-41cc-834e-cfd319583c05 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:33.056742 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0173faf1-5c3c-4440-aece-7a6830d8dbf5 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:33.064744 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0173faf1-5c3c-4440-aece-7a6830d8dbf5 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1514 microversion: 2.1 time: 0.169603 Nov 23 14:32:33.065513 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 190/380] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:32 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:33.107938 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ed00bfd4-2f93-4bd2-9a76-bc1ce2a1bf73 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:33.108468 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ed00bfd4-2f93-4bd2-9a76-bc1ce2a1bf73 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:33.115789 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ed00bfd4-2f93-4bd2-9a76-bc1ce2a1bf73 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:33.116375 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ed00bfd4-2f93-4bd2-9a76-bc1ce2a1bf73 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:33.117244 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ed00bfd4-2f93-4bd2-9a76-bc1ce2a1bf73 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:33.117742 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ed00bfd4-2f93-4bd2-9a76-bc1ce2a1bf73 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:33.149184 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ed00bfd4-2f93-4bd2-9a76-bc1ce2a1bf73 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Going to try to terminate instance {{(pid=116787) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:32:33.547304 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ed00bfd4-2f93-4bd2-9a76-bc1ce2a1bf73 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 204 len: 0 microversion: 2.1 time: 0.442818 Nov 23 14:32:33.548179 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 191/381] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:32:33 2021] DELETE /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 14:32:33.557411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-be48a67d-0654-40e8-89ca-a204b121381b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1252614858", "imageRef": "b06b9241-c147-436d-86bb-7c49ad8ef09c", "flavorRef": "452", "networks": [{"uuid": "a238991b-9612-42e1-988f-c440e19d18f2"}]}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:33.753665 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.network.neutron [None req-be48a67d-0654-40e8-89ca-a204b121381b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] validate_networks() for [('a238991b-9612-42e1-988f-c440e19d18f2', None, None, None, None, None)] {{(pid=116787) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:32:33.926209 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bf06b190-d9a3-41cc-834e-cfd319583c05 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "POST /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.935117 Nov 23 14:32:33.927586 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 191/382] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Nov 23 14:32:32 2021] POST /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710/os-volume_attachments => generated 194 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:32:33.939324 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b5cfaf77-f207-420c-87d6-dfb7616c4318 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:33.940433 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b5cfaf77-f207-420c-87d6-dfb7616c4318 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:33.956988 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b5cfaf77-f207-420c-87d6-dfb7616c4318 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:33.958669 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b5cfaf77-f207-420c-87d6-dfb7616c4318 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:33.958669 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b5cfaf77-f207-420c-87d6-dfb7616c4318 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:33.960098 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b5cfaf77-f207-420c-87d6-dfb7616c4318 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:34.051523 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b5cfaf77-f207-420c-87d6-dfb7616c4318 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28421 microversion: 2.1 time: 0.121994 Nov 23 14:32:34.052231 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 192/383] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:33 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28421 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:34.061474 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-91af594a-e68b-4b19-9e37-d0df0ebe194b tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:34.062350 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-91af594a-e68b-4b19-9e37-d0df0ebe194b tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:34.071226 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-91af594a-e68b-4b19-9e37-d0df0ebe194b tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:34.071734 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-91af594a-e68b-4b19-9e37-d0df0ebe194b tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:34.072507 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-91af594a-e68b-4b19-9e37-d0df0ebe194b tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:34.073806 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-91af594a-e68b-4b19-9e37-d0df0ebe194b tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:34.165808 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-be48a67d-0654-40e8-89ca-a204b121381b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Flavor limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:32:34.166285 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-be48a67d-0654-40e8-89ca-a204b121381b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Image limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:32:34.166762 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-be48a67d-0654-40e8-89ca-a204b121381b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Flavor pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:32:34.167211 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-be48a67d-0654-40e8-89ca-a204b121381b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Image pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:32:34.167663 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-be48a67d-0654-40e8-89ca-a204b121381b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:32:34.177231 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-be48a67d-0654-40e8-89ca-a204b121381b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:34.177682 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-be48a67d-0654-40e8-89ca-a204b121381b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:34.178494 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-be48a67d-0654-40e8-89ca-a204b121381b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:34.178933 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-be48a67d-0654-40e8-89ca-a204b121381b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:34.196299 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-be48a67d-0654-40e8-89ca-a204b121381b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Getting quotas for project 374651ab7b774bf6b1d6c8ac7a94bdb8. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:32:34.200206 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-be48a67d-0654-40e8-89ca-a204b121381b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Getting quotas for user 1ab6b03dcab74efd8ed186b0330a5555 and project 374651ab7b774bf6b1d6c8ac7a94bdb8. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:32:34.213857 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-be48a67d-0654-40e8-89ca-a204b121381b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Going to run 1 instances... {{(pid=116787) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:32:34.214165 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-be48a67d-0654-40e8-89ca-a204b121381b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b06b9241-c147-436d-86bb-7c49ad8ef09c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:32:34.244358 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-91af594a-e68b-4b19-9e37-d0df0ebe194b tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:34.246907 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-91af594a-e68b-4b19-9e37-d0df0ebe194b tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1504 microversion: 2.1 time: 0.193480 Nov 23 14:32:34.247473 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 193/384] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:34 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:34.251865 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-44f71a49-32dd-4a2f-a7a9-d60d0f20b044 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:34.252780 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-44f71a49-32dd-4a2f-a7a9-d60d0f20b044 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:34.258882 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-44f71a49-32dd-4a2f-a7a9-d60d0f20b044 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:34.259324 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-44f71a49-32dd-4a2f-a7a9-d60d0f20b044 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:34.260124 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-44f71a49-32dd-4a2f-a7a9-d60d0f20b044 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:34.260589 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-44f71a49-32dd-4a2f-a7a9-d60d0f20b044 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:34.343094 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-44f71a49-32dd-4a2f-a7a9-d60d0f20b044 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28487 microversion: 2.20 time: 0.094396 Nov 23 14:32:34.343856 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 194/385] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:34 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28487 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:34.354570 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-be48a67d-0654-40e8-89ca-a204b121381b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805013 Nov 23 14:32:34.355209 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 192/386] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:32:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 14:32:34.385811 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-edecc401-3284-4f6c-b634-1e1689e8fe5b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:34.386557 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-edecc401-3284-4f6c-b634-1e1689e8fe5b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:34.449429 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-edecc401-3284-4f6c-b634-1e1689e8fe5b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:34.455821 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-edecc401-3284-4f6c-b634-1e1689e8fe5b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1219 microversion: 2.1 time: 0.094430 Nov 23 14:32:34.456642 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 195/387] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:34 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:35.067030 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b2405949-1c50-464b-9f53-eccf24924d96 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:35.070130 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b2405949-1c50-464b-9f53-eccf24924d96 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:35.077196 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b2405949-1c50-464b-9f53-eccf24924d96 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:35.077765 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b2405949-1c50-464b-9f53-eccf24924d96 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:35.078624 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b2405949-1c50-464b-9f53-eccf24924d96 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:35.079140 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b2405949-1c50-464b-9f53-eccf24924d96 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:35.181240 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b2405949-1c50-464b-9f53-eccf24924d96 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.121178 Nov 23 14:32:35.189099 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 193/388] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:35 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:35.265614 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-2dcc854c-ab17-4a8c-bfde-9999b9dd4a0d tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:35.266330 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-2dcc854c-ab17-4a8c-bfde-9999b9dd4a0d tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:35.273579 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2dcc854c-ab17-4a8c-bfde-9999b9dd4a0d tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:35.274106 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2dcc854c-ab17-4a8c-bfde-9999b9dd4a0d tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:35.274965 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2dcc854c-ab17-4a8c-bfde-9999b9dd4a0d tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:35.275467 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2dcc854c-ab17-4a8c-bfde-9999b9dd4a0d tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:35.355847 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-eb9c8536-64b2-41e0-97cd-5f9a0ea7498e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:35.357150 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-eb9c8536-64b2-41e0-97cd-5f9a0ea7498e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:35.365987 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-eb9c8536-64b2-41e0-97cd-5f9a0ea7498e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:35.366593 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-eb9c8536-64b2-41e0-97cd-5f9a0ea7498e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:35.367506 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-eb9c8536-64b2-41e0-97cd-5f9a0ea7498e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:35.369346 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-eb9c8536-64b2-41e0-97cd-5f9a0ea7498e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:35.447273 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-2dcc854c-ab17-4a8c-bfde-9999b9dd4a0d tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:35.450763 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-eb9c8536-64b2-41e0-97cd-5f9a0ea7498e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28487 microversion: 2.20 time: 0.098779 Nov 23 14:32:35.451734 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 194/389] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:35 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28487 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:32:35.455155 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-2dcc854c-ab17-4a8c-bfde-9999b9dd4a0d tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1504 microversion: 2.1 time: 0.193331 Nov 23 14:32:35.455756 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 196/390] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:35 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:35.472944 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5b5787d2-372f-4a63-a6d2-e5d95ed0e5f8 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:35.474178 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5b5787d2-372f-4a63-a6d2-e5d95ed0e5f8 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:35.481282 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5b5787d2-372f-4a63-a6d2-e5d95ed0e5f8 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:35.481757 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5b5787d2-372f-4a63-a6d2-e5d95ed0e5f8 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:35.482611 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5b5787d2-372f-4a63-a6d2-e5d95ed0e5f8 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:35.483000 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5b5787d2-372f-4a63-a6d2-e5d95ed0e5f8 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:35.558772 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5b5787d2-372f-4a63-a6d2-e5d95ed0e5f8 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:35.566060 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5b5787d2-372f-4a63-a6d2-e5d95ed0e5f8 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1223 microversion: 2.1 time: 0.097046 Nov 23 14:32:35.566681 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 195/391] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:35 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:35.893825 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-77b1d3f1-a68b-423f-a2b1-d02e3bc5c826 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:35.894570 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-77b1d3f1-a68b-423f-a2b1-d02e3bc5c826 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:35.902661 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-77b1d3f1-a68b-423f-a2b1-d02e3bc5c826 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:35.903569 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-77b1d3f1-a68b-423f-a2b1-d02e3bc5c826 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:35.906748 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-77b1d3f1-a68b-423f-a2b1-d02e3bc5c826 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:35.906748 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-77b1d3f1-a68b-423f-a2b1-d02e3bc5c826 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:36.146412 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-77b1d3f1-a68b-423f-a2b1-d02e3bc5c826 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:36.163641 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-e45cb333-c02c-4bd9-ab8e-eca0c6f5a7a4 req-1ac56231-89a5-4676-8449-bd8f79b55f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c", "name": "network-vif-deleted", "tag": "c85a6d3a-c869-40b2-b0e9-5274f94633b1"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:36.164355 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-77b1d3f1-a68b-423f-a2b1-d02e3bc5c826 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1514 microversion: 2.1 time: 0.270884 Nov 23 14:32:36.165200 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 197/392] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:35 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1514 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:36.172378 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:32:36.172378 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:32:36.173692 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-e45cb333-c02c-4bd9-ab8e-eca0c6f5a7a4 req-1ac56231-89a5-4676-8449-bd8f79b55f54 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:36.174199 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-e45cb333-c02c-4bd9-ab8e-eca0c6f5a7a4 req-1ac56231-89a5-4676-8449-bd8f79b55f54 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:36.182464 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e6f2dabe-b162-4cbb-a440-9cfefa27b8a4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a66132b0-c23d-4f0d-b1c7-9cf437531575"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:36.183549 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e6f2dabe-b162-4cbb-a440-9cfefa27b8a4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:36.190964 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e6f2dabe-b162-4cbb-a440-9cfefa27b8a4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:36.192620 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e6f2dabe-b162-4cbb-a440-9cfefa27b8a4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:36.192986 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-e45cb333-c02c-4bd9-ab8e-eca0c6f5a7a4 req-1ac56231-89a5-4676-8449-bd8f79b55f54 service nova] Creating event network-vif-deleted:c85a6d3a-c869-40b2-b0e9-5274f94633b1 for instance 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c on hv-cinder-80475 Nov 23 14:32:36.193367 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e6f2dabe-b162-4cbb-a440-9cfefa27b8a4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:36.193886 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e6f2dabe-b162-4cbb-a440-9cfefa27b8a4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:36.198524 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-e45cb333-c02c-4bd9-ab8e-eca0c6f5a7a4 req-1ac56231-89a5-4676-8449-bd8f79b55f54 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038829 Nov 23 14:32:36.198886 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 196/393] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:32:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:32:36.205418 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-49d2d08c-eee8-49b6-bb88-f1e6c476f14e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:36.206581 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-49d2d08c-eee8-49b6-bb88-f1e6c476f14e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:36.214327 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-49d2d08c-eee8-49b6-bb88-f1e6c476f14e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:36.215265 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-49d2d08c-eee8-49b6-bb88-f1e6c476f14e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:36.216007 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-49d2d08c-eee8-49b6-bb88-f1e6c476f14e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:36.216616 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-49d2d08c-eee8-49b6-bb88-f1e6c476f14e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:36.287651 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-49d2d08c-eee8-49b6-bb88-f1e6c476f14e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.087163 Nov 23 14:32:36.288588 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 197/394] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:36 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:36.463533 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-17812938-c21f-461c-80cb-332690751943 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:36.464569 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-17812938-c21f-461c-80cb-332690751943 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:36.471307 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-17812938-c21f-461c-80cb-332690751943 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:36.471753 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-17812938-c21f-461c-80cb-332690751943 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:36.472672 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-17812938-c21f-461c-80cb-332690751943 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:36.473126 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-17812938-c21f-461c-80cb-332690751943 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:36.558790 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-17812938-c21f-461c-80cb-332690751943 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.099159 Nov 23 14:32:36.559697 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 198/395] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:36 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:36.564341 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f5c948fb-6af1-401a-9a6c-2afd01970570 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:36.565030 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f5c948fb-6af1-401a-9a6c-2afd01970570 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:36.572555 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f5c948fb-6af1-401a-9a6c-2afd01970570 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:36.573663 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f5c948fb-6af1-401a-9a6c-2afd01970570 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:36.573982 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f5c948fb-6af1-401a-9a6c-2afd01970570 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:36.574415 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f5c948fb-6af1-401a-9a6c-2afd01970570 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:36.607187 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f5c948fb-6af1-401a-9a6c-2afd01970570 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:36.607755 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f5c948fb-6af1-401a-9a6c-2afd01970570 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:36.608262 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-f5c948fb-6af1-401a-9a6c-2afd01970570 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lazy-loading 'fault' on Instance uuid 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:32:36.658757 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f5c948fb-6af1-401a-9a6c-2afd01970570 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d07bdc2fc3343af84a3899c2ad7302b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebe2cb2394a4a3199c5df49b8793c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:36.665720 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f5c948fb-6af1-401a-9a6c-2afd01970570 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 200 len: 1304 microversion: 2.1 time: 0.105016 Nov 23 14:32:36.666285 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 199/396] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:36 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:36.670533 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1cba30e9-14e1-4bda-b7ec-93cb7fa57592 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:36.671153 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1cba30e9-14e1-4bda-b7ec-93cb7fa57592 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:36.677845 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1cba30e9-14e1-4bda-b7ec-93cb7fa57592 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:36.678292 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1cba30e9-14e1-4bda-b7ec-93cb7fa57592 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:36.679067 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1cba30e9-14e1-4bda-b7ec-93cb7fa57592 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:36.679498 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1cba30e9-14e1-4bda-b7ec-93cb7fa57592 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:36.738427 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-1cba30e9-14e1-4bda-b7ec-93cb7fa57592 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:36.746474 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1cba30e9-14e1-4bda-b7ec-93cb7fa57592 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1271 microversion: 2.1 time: 0.079188 Nov 23 14:32:36.747086 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 200/397] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:36 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1271 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:36.962460 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e6f2dabe-b162-4cbb-a440-9cfefa27b8a4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "POST /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784812 Nov 23 14:32:36.963006 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 198/398] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Nov 23 14:32:36 2021] POST /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:32:37.299766 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-32911e30-0ff6-4848-9973-ed282de534f8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:37.300863 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-32911e30-0ff6-4848-9973-ed282de534f8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:37.308175 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-32911e30-0ff6-4848-9973-ed282de534f8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:37.308657 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-32911e30-0ff6-4848-9973-ed282de534f8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:37.309437 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-32911e30-0ff6-4848-9973-ed282de534f8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:37.310156 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-32911e30-0ff6-4848-9973-ed282de534f8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:37.401566 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-32911e30-0ff6-4848-9973-ed282de534f8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.105598 Nov 23 14:32:37.402306 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 201/399] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:37 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:37.571670 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d4f9cdd3-ac1c-4252-a736-93610eaafe85 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:37.572605 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d4f9cdd3-ac1c-4252-a736-93610eaafe85 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:37.578521 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d4f9cdd3-ac1c-4252-a736-93610eaafe85 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:37.578949 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d4f9cdd3-ac1c-4252-a736-93610eaafe85 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:37.579724 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d4f9cdd3-ac1c-4252-a736-93610eaafe85 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:37.580156 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d4f9cdd3-ac1c-4252-a736-93610eaafe85 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:37.656092 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d4f9cdd3-ac1c-4252-a736-93610eaafe85 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.088978 Nov 23 14:32:37.656776 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 199/400] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:37 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:37.684003 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-649e619b-3d52-40b1-9332-3787c42d6e64 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:37.684710 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-649e619b-3d52-40b1-9332-3787c42d6e64 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] [instance: 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:37.691374 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-649e619b-3d52-40b1-9332-3787c42d6e64 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:37.691817 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-649e619b-3d52-40b1-9332-3787c42d6e64 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:37.692609 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-649e619b-3d52-40b1-9332-3787c42d6e64 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:37.693035 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-649e619b-3d52-40b1-9332-3787c42d6e64 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:37.706505 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-649e619b-3d52-40b1-9332-3787c42d6e64 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] HTTP exception thrown: Instance 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c could not be found. Nov 23 14:32:37.707071 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-649e619b-3d52-40b1-9332-3787c42d6e64 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] Returning 404 to user: Instance 0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:32:37.707898 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-649e619b-3d52-40b1-9332-3787c42d6e64 tempest-VolumesActionsTest-1123669206 tempest-VolumesActionsTest-1123669206-project] 10.222.0.82 "GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c" status: 404 len: 111 microversion: 2.1 time: 0.028092 Nov 23 14:32:37.708608 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 202/401] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:37 2021] GET /compute/v2.1/servers/0f15f5c6-7035-4fcd-aa3f-55c0c3f2bb1c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:32:37.766188 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-249d9723-6464-41d0-9295-3ca2405e71fa tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:37.766885 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-249d9723-6464-41d0-9295-3ca2405e71fa tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:37.774016 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-249d9723-6464-41d0-9295-3ca2405e71fa tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:37.774461 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-249d9723-6464-41d0-9295-3ca2405e71fa tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:37.775231 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-249d9723-6464-41d0-9295-3ca2405e71fa tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:37.775685 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-249d9723-6464-41d0-9295-3ca2405e71fa tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:38.049560 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-249d9723-6464-41d0-9295-3ca2405e71fa tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:38.057520 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-249d9723-6464-41d0-9295-3ca2405e71fa tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1319 microversion: 2.1 time: 0.295265 Nov 23 14:32:38.058318 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 200/402] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:37 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:38.413555 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5bdcc409-1cb6-42c1-a6cb-176353819cb4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:38.414462 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5bdcc409-1cb6-42c1-a6cb-176353819cb4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:38.420832 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5bdcc409-1cb6-42c1-a6cb-176353819cb4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:38.421285 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5bdcc409-1cb6-42c1-a6cb-176353819cb4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:38.422055 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5bdcc409-1cb6-42c1-a6cb-176353819cb4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:38.422483 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5bdcc409-1cb6-42c1-a6cb-176353819cb4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:38.487827 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5bdcc409-1cb6-42c1-a6cb-176353819cb4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.077438 Nov 23 14:32:38.488410 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 203/403] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:38 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:32:38.578006 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-467cca0e-4ae7-4866-8fa2-0f11add0ea99 req-c0b60a3f-6c62-484c-91e2-97b26683c95d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66d63f1e-28e8-4644-a848-e1c1820b86f1", "tag": "b583cf1d-49a4-4160-adc2-d5b91008581e"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:38.580029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:32:38.580029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:32:38.588437 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-467cca0e-4ae7-4866-8fa2-0f11add0ea99 req-c0b60a3f-6c62-484c-91e2-97b26683c95d service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:38.588872 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-467cca0e-4ae7-4866-8fa2-0f11add0ea99 req-c0b60a3f-6c62-484c-91e2-97b26683c95d service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:38.599597 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-467cca0e-4ae7-4866-8fa2-0f11add0ea99 req-c0b60a3f-6c62-484c-91e2-97b26683c95d service nova] Creating event network-changed:b583cf1d-49a4-4160-adc2-d5b91008581e for instance 66d63f1e-28e8-4644-a848-e1c1820b86f1 on hv-cinder-80475 Nov 23 14:32:38.604962 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-467cca0e-4ae7-4866-8fa2-0f11add0ea99 req-c0b60a3f-6c62-484c-91e2-97b26683c95d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031320 Nov 23 14:32:38.605877 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 201/404] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:32:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:32:38.668097 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-dcb8505c-182b-40a7-a5a2-b17095dfaf06 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:38.669107 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-dcb8505c-182b-40a7-a5a2-b17095dfaf06 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:38.676023 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dcb8505c-182b-40a7-a5a2-b17095dfaf06 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:38.677021 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dcb8505c-182b-40a7-a5a2-b17095dfaf06 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:38.677851 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dcb8505c-182b-40a7-a5a2-b17095dfaf06 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:38.678287 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dcb8505c-182b-40a7-a5a2-b17095dfaf06 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:38.791361 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-dcb8505c-182b-40a7-a5a2-b17095dfaf06 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.127102 Nov 23 14:32:38.792104 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 204/405] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:38 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:39.079787 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-50156957-36d6-467a-a45f-64cc8b043cc2 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:39.080670 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-50156957-36d6-467a-a45f-64cc8b043cc2 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:39.089726 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-50156957-36d6-467a-a45f-64cc8b043cc2 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:39.090396 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-50156957-36d6-467a-a45f-64cc8b043cc2 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:39.091249 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-50156957-36d6-467a-a45f-64cc8b043cc2 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:39.091787 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-50156957-36d6-467a-a45f-64cc8b043cc2 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:39.463844 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-50156957-36d6-467a-a45f-64cc8b043cc2 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:39.481698 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-50156957-36d6-467a-a45f-64cc8b043cc2 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1319 microversion: 2.1 time: 0.405632 Nov 23 14:32:39.482711 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 202/406] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:39 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:39.499313 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-64815159-1ae9-49b3-a634-488930d0acf2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:39.500485 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-64815159-1ae9-49b3-a634-488930d0acf2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:39.507596 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-64815159-1ae9-49b3-a634-488930d0acf2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:39.508107 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-64815159-1ae9-49b3-a634-488930d0acf2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:39.512018 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-64815159-1ae9-49b3-a634-488930d0acf2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:39.512018 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-64815159-1ae9-49b3-a634-488930d0acf2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:39.802951 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-4f3471d4-b98d-4113-adaa-fff9631c9504 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:39.803908 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-4f3471d4-b98d-4113-adaa-fff9631c9504 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:39.809712 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4f3471d4-b98d-4113-adaa-fff9631c9504 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:39.810152 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4f3471d4-b98d-4113-adaa-fff9631c9504 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:39.810913 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4f3471d4-b98d-4113-adaa-fff9631c9504 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:39.811340 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4f3471d4-b98d-4113-adaa-fff9631c9504 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:40.124546 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-64815159-1ae9-49b3-a634-488930d0acf2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.628977 Nov 23 14:32:40.136282 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 205/407] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:39 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:32:40.136535 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-4f3471d4-b98d-4113-adaa-fff9631c9504 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.328547 Nov 23 14:32:40.136535 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 203/408] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:39 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:32:40.498837 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ba556894-ddb2-49f0-9ce8-4f4992e95ca1 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:40.499519 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ba556894-ddb2-49f0-9ce8-4f4992e95ca1 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:40.511317 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ba556894-ddb2-49f0-9ce8-4f4992e95ca1 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:40.511757 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ba556894-ddb2-49f0-9ce8-4f4992e95ca1 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:40.512573 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ba556894-ddb2-49f0-9ce8-4f4992e95ca1 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:40.512999 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ba556894-ddb2-49f0-9ce8-4f4992e95ca1 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:40.646348 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ba556894-ddb2-49f0-9ce8-4f4992e95ca1 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:40.653902 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ba556894-ddb2-49f0-9ce8-4f4992e95ca1 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1319 microversion: 2.1 time: 0.158993 Nov 23 14:32:40.654451 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 206/409] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:40 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:41.140716 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-03c4cf7e-d38b-4b48-84b3-29adacedc6a6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:41.141785 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-03c4cf7e-d38b-4b48-84b3-29adacedc6a6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:41.149633 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-03c4cf7e-d38b-4b48-84b3-29adacedc6a6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:41.150079 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-03c4cf7e-d38b-4b48-84b3-29adacedc6a6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:41.150845 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-03c4cf7e-d38b-4b48-84b3-29adacedc6a6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:41.151279 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-03c4cf7e-d38b-4b48-84b3-29adacedc6a6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:41.175890 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8013df6d-ef2a-4e99-a827-8eada6d128f0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:41.177017 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8013df6d-ef2a-4e99-a827-8eada6d128f0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:41.183460 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8013df6d-ef2a-4e99-a827-8eada6d128f0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:41.183908 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8013df6d-ef2a-4e99-a827-8eada6d128f0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:41.184724 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8013df6d-ef2a-4e99-a827-8eada6d128f0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:41.185166 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8013df6d-ef2a-4e99-a827-8eada6d128f0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:45.102719 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8013df6d-ef2a-4e99-a827-8eada6d128f0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 3.930778 Nov 23 14:32:45.103405 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 207/410] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:41 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 3933 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:32:45.108366 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d7e3f086-f8ec-4646-8eff-98e8c81c5e2d tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:45.109067 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d7e3f086-f8ec-4646-8eff-98e8c81c5e2d tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:45.111239 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-03c4cf7e-d38b-4b48-84b3-29adacedc6a6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 3.974389 Nov 23 14:32:45.111880 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 204/411] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:41 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 3976 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:45.116981 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d7e3f086-f8ec-4646-8eff-98e8c81c5e2d tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:45.117435 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d7e3f086-f8ec-4646-8eff-98e8c81c5e2d tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:45.118223 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d7e3f086-f8ec-4646-8eff-98e8c81c5e2d tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:45.118658 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d7e3f086-f8ec-4646-8eff-98e8c81c5e2d tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:45.248406 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d7e3f086-f8ec-4646-8eff-98e8c81c5e2d tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:45.258240 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d7e3f086-f8ec-4646-8eff-98e8c81c5e2d tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1319 microversion: 2.1 time: 0.153691 Nov 23 14:32:45.261975 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 208/412] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:45 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:46.114247 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-cd76e03d-b65a-4820-aae2-eba9d98f24a7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:46.115321 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-cd76e03d-b65a-4820-aae2-eba9d98f24a7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:46.122687 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-23594a93-b1b8-45f5-a2ad-55c7a1b279ae tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:46.123165 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cd76e03d-b65a-4820-aae2-eba9d98f24a7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:46.123490 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cd76e03d-b65a-4820-aae2-eba9d98f24a7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:46.123589 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-23594a93-b1b8-45f5-a2ad-55c7a1b279ae tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:46.124276 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cd76e03d-b65a-4820-aae2-eba9d98f24a7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:46.124712 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cd76e03d-b65a-4820-aae2-eba9d98f24a7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:46.129700 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-23594a93-b1b8-45f5-a2ad-55c7a1b279ae tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:46.130143 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-23594a93-b1b8-45f5-a2ad-55c7a1b279ae tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:46.130951 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-23594a93-b1b8-45f5-a2ad-55c7a1b279ae tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:46.131422 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-23594a93-b1b8-45f5-a2ad-55c7a1b279ae tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:48.850972 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-cd76e03d-b65a-4820-aae2-eba9d98f24a7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 2.740376 Nov 23 14:32:48.854858 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 205/413] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:46 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 2742 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:48.856213 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-23594a93-b1b8-45f5-a2ad-55c7a1b279ae tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 2.736994 Nov 23 14:32:48.856635 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f4a9ff9a-3bbc-45e2-8558-807c9875ad17 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:48.857205 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 209/414] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:46 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 2739 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:32:48.857337 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f4a9ff9a-3bbc-45e2-8558-807c9875ad17 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:48.864827 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f4a9ff9a-3bbc-45e2-8558-807c9875ad17 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:48.866029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f4a9ff9a-3bbc-45e2-8558-807c9875ad17 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:48.866809 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f4a9ff9a-3bbc-45e2-8558-807c9875ad17 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:48.867253 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f4a9ff9a-3bbc-45e2-8558-807c9875ad17 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:48.998901 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-f4a9ff9a-3bbc-45e2-8558-807c9875ad17 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:49.006199 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f4a9ff9a-3bbc-45e2-8558-807c9875ad17 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1319 microversion: 2.1 time: 0.153225 Nov 23 14:32:49.006804 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 206/415] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:48 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:49.863079 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0951ff53-4af9-470e-a28c-d528c7be902c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:49.864182 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0951ff53-4af9-470e-a28c-d528c7be902c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:49.868143 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1eedc1d7-67fc-41fe-9c56-fa2c8c4f3dd6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:49.869076 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1eedc1d7-67fc-41fe-9c56-fa2c8c4f3dd6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:49.871622 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0951ff53-4af9-470e-a28c-d528c7be902c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:49.872069 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0951ff53-4af9-470e-a28c-d528c7be902c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:49.872881 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0951ff53-4af9-470e-a28c-d528c7be902c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:49.873351 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0951ff53-4af9-470e-a28c-d528c7be902c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:49.875311 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1eedc1d7-67fc-41fe-9c56-fa2c8c4f3dd6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:49.875700 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1eedc1d7-67fc-41fe-9c56-fa2c8c4f3dd6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:49.876494 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1eedc1d7-67fc-41fe-9c56-fa2c8c4f3dd6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:49.876921 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1eedc1d7-67fc-41fe-9c56-fa2c8c4f3dd6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:50.539126 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1eedc1d7-67fc-41fe-9c56-fa2c8c4f3dd6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.674985 Nov 23 14:32:50.539967 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 207/416] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:49 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:50.543247 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0951ff53-4af9-470e-a28c-d528c7be902c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.683207 Nov 23 14:32:50.543247 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 210/417] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:49 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:50.544787 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-75d30037-fcb6-4aea-984f-0e839c653044 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:50.545481 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-75d30037-fcb6-4aea-984f-0e839c653044 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:50.552177 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-75d30037-fcb6-4aea-984f-0e839c653044 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:50.552932 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-75d30037-fcb6-4aea-984f-0e839c653044 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:50.553431 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-75d30037-fcb6-4aea-984f-0e839c653044 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:50.553865 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-75d30037-fcb6-4aea-984f-0e839c653044 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:50.687519 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-75d30037-fcb6-4aea-984f-0e839c653044 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:50.694916 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-75d30037-fcb6-4aea-984f-0e839c653044 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1319 microversion: 2.1 time: 0.154013 Nov 23 14:32:50.695484 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 208/418] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:50 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:51.551370 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8cd1e641-0ca8-4788-930c-76fd42b0ce88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:51.552409 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8cd1e641-0ca8-4788-930c-76fd42b0ce88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:51.554228 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7ec1eae1-16fc-4d69-9139-3416390f985e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:51.555129 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7ec1eae1-16fc-4d69-9139-3416390f985e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:51.560214 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8cd1e641-0ca8-4788-930c-76fd42b0ce88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:51.560728 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8cd1e641-0ca8-4788-930c-76fd42b0ce88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:51.561457 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ec1eae1-16fc-4d69-9139-3416390f985e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:51.561566 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8cd1e641-0ca8-4788-930c-76fd42b0ce88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:51.561896 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ec1eae1-16fc-4d69-9139-3416390f985e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:51.561989 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8cd1e641-0ca8-4788-930c-76fd42b0ce88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:51.562668 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ec1eae1-16fc-4d69-9139-3416390f985e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:51.563102 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ec1eae1-16fc-4d69-9139-3416390f985e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:51.715190 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7ec1eae1-16fc-4d69-9139-3416390f985e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.165051 Nov 23 14:32:51.715845 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 209/419] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:51 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:32:51.720571 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d5eb886a-5b6f-4644-a2eb-0d0e8100c2a3 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:51.721258 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d5eb886a-5b6f-4644-a2eb-0d0e8100c2a3 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:51.728211 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d5eb886a-5b6f-4644-a2eb-0d0e8100c2a3 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:51.728694 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d5eb886a-5b6f-4644-a2eb-0d0e8100c2a3 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:51.729456 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d5eb886a-5b6f-4644-a2eb-0d0e8100c2a3 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:51.729879 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d5eb886a-5b6f-4644-a2eb-0d0e8100c2a3 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:51.736733 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8cd1e641-0ca8-4788-930c-76fd42b0ce88 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.189221 Nov 23 14:32:51.737374 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 211/420] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:51 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:51.868017 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d5eb886a-5b6f-4644-a2eb-0d0e8100c2a3 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:51.875921 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d5eb886a-5b6f-4644-a2eb-0d0e8100c2a3 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1319 microversion: 2.1 time: 0.158948 Nov 23 14:32:51.876507 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 210/421] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:51 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:52.247998 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ff907c92-4724-4d2e-8985-0dd8edd815a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-90208341", "imageRef": "b06b9241-c147-436d-86bb-7c49ad8ef09c", "flavorRef": "452", "networks": [{"uuid": "91c21480-0f27-4f06-9850-471f208e0ee5"}]}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:52.304922 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.network.neutron [None req-ff907c92-4724-4d2e-8985-0dd8edd815a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] validate_networks() for [('91c21480-0f27-4f06-9850-471f208e0ee5', None, None, None, None, None)] {{(pid=116787) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:32:52.703240 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-ff907c92-4724-4d2e-8985-0dd8edd815a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Flavor limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:32:52.703844 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-ff907c92-4724-4d2e-8985-0dd8edd815a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Image limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:32:52.704111 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-ff907c92-4724-4d2e-8985-0dd8edd815a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Flavor pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:32:52.704723 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-ff907c92-4724-4d2e-8985-0dd8edd815a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Image pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:32:52.705125 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-ff907c92-4724-4d2e-8985-0dd8edd815a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:32:52.716666 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ff907c92-4724-4d2e-8985-0dd8edd815a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:52.717108 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ff907c92-4724-4d2e-8985-0dd8edd815a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:52.717906 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ff907c92-4724-4d2e-8985-0dd8edd815a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:52.718334 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ff907c92-4724-4d2e-8985-0dd8edd815a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:52.726916 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-52219898-12ec-4871-a569-028f0b548aaf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:52.727899 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-52219898-12ec-4871-a569-028f0b548aaf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:52.734504 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-52219898-12ec-4871-a569-028f0b548aaf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:52.734661 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-ff907c92-4724-4d2e-8985-0dd8edd815a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Getting quotas for project 368da8317e0d4261811a214a941624dc. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:32:52.735561 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-52219898-12ec-4871-a569-028f0b548aaf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:52.737077 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-52219898-12ec-4871-a569-028f0b548aaf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:52.737713 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-52219898-12ec-4871-a569-028f0b548aaf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:52.745261 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-ff907c92-4724-4d2e-8985-0dd8edd815a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Getting quotas for user a5f5f781b89d41e091d59e326a5e4db5 and project 368da8317e0d4261811a214a941624dc. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:32:52.755433 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ff907c92-4724-4d2e-8985-0dd8edd815a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Going to run 1 instances... {{(pid=116787) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:32:52.759887 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ff907c92-4724-4d2e-8985-0dd8edd815a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b06b9241-c147-436d-86bb-7c49ad8ef09c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:32:52.895043 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-52219898-12ec-4871-a569-028f0b548aaf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.171912 Nov 23 14:32:52.895770 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 211/422] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:52 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:32:52.912037 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b3877c32-34c5-4e7a-9108-15cdc8c03b4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:52.915796 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b3877c32-34c5-4e7a-9108-15cdc8c03b4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:52.925337 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ff907c92-4724-4d2e-8985-0dd8edd815a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681338 Nov 23 14:32:52.926507 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 212/423] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:32:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 14:32:52.936532 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b3877c32-34c5-4e7a-9108-15cdc8c03b4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:52.937463 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b3877c32-34c5-4e7a-9108-15cdc8c03b4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:52.938876 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b3877c32-34c5-4e7a-9108-15cdc8c03b4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:52.939633 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b3877c32-34c5-4e7a-9108-15cdc8c03b4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:52.958472 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-72d80a99-c820-4f44-847c-4993de12ebde tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:52.965618 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-72d80a99-c820-4f44-847c-4993de12ebde tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:52.980565 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-72d80a99-c820-4f44-847c-4993de12ebde tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:52.982530 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-72d80a99-c820-4f44-847c-4993de12ebde tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:52.984575 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-72d80a99-c820-4f44-847c-4993de12ebde tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:52.985312 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-72d80a99-c820-4f44-847c-4993de12ebde tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:53.029748 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b3877c32-34c5-4e7a-9108-15cdc8c03b4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.131372 Nov 23 14:32:53.031940 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 212/424] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:52 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:53.039573 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ebe49ba8-078d-461a-8735-1778d361c642 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:53.040994 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ebe49ba8-078d-461a-8735-1778d361c642 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:53.155166 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ebe49ba8-078d-461a-8735-1778d361c642 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:53.167277 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ebe49ba8-078d-461a-8735-1778d361c642 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1216 microversion: 2.1 time: 0.133727 Nov 23 14:32:53.167918 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 213/425] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:53 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1216 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:53.200559 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-72d80a99-c820-4f44-847c-4993de12ebde tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:53.250800 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-72d80a99-c820-4f44-847c-4993de12ebde tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1319 microversion: 2.1 time: 0.294513 Nov 23 14:32:53.250800 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 213/426] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:52 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:53.911318 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-78fc8c4f-328a-40fa-a373-3b9e07249576 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:53.912434 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-78fc8c4f-328a-40fa-a373-3b9e07249576 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:53.919775 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-78fc8c4f-328a-40fa-a373-3b9e07249576 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:53.920136 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-78fc8c4f-328a-40fa-a373-3b9e07249576 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:53.921010 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-78fc8c4f-328a-40fa-a373-3b9e07249576 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:53.922100 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-78fc8c4f-328a-40fa-a373-3b9e07249576 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:54.024425 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-78fc8c4f-328a-40fa-a373-3b9e07249576 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.119826 Nov 23 14:32:54.025183 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 214/427] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:53 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:54.044509 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-20da106a-7615-4843-a278-d1bd65b226a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:54.047941 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-20da106a-7615-4843-a278-d1bd65b226a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:54.056903 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-20da106a-7615-4843-a278-d1bd65b226a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:54.062664 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-20da106a-7615-4843-a278-d1bd65b226a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:54.062664 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-20da106a-7615-4843-a278-d1bd65b226a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:54.062664 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-20da106a-7615-4843-a278-d1bd65b226a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:54.163435 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-20da106a-7615-4843-a278-d1bd65b226a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.121945 Nov 23 14:32:54.164390 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 214/428] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:54 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:54.190208 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9c2d8bb5-22e7-4678-9892-dcc5becb822e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:54.191155 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9c2d8bb5-22e7-4678-9892-dcc5becb822e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:54.205556 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9c2d8bb5-22e7-4678-9892-dcc5becb822e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:54.206333 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9c2d8bb5-22e7-4678-9892-dcc5becb822e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:54.207190 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9c2d8bb5-22e7-4678-9892-dcc5becb822e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:54.207849 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9c2d8bb5-22e7-4678-9892-dcc5becb822e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:54.287150 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-813ae33e-df1b-4d80-af84-96e709bccb7a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:54.288609 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-813ae33e-df1b-4d80-af84-96e709bccb7a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:54.324133 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-813ae33e-df1b-4d80-af84-96e709bccb7a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:54.324724 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-813ae33e-df1b-4d80-af84-96e709bccb7a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:54.325785 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-813ae33e-df1b-4d80-af84-96e709bccb7a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:54.329522 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-813ae33e-df1b-4d80-af84-96e709bccb7a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:54.343275 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9c2d8bb5-22e7-4678-9892-dcc5becb822e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:54.386904 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9c2d8bb5-22e7-4678-9892-dcc5becb822e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1220 microversion: 2.1 time: 0.200613 Nov 23 14:32:54.396269 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 215/429] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:54 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1220 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:54.569927 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-813ae33e-df1b-4d80-af84-96e709bccb7a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:54.578056 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-813ae33e-df1b-4d80-af84-96e709bccb7a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1319 microversion: 2.1 time: 0.298940 Nov 23 14:32:54.578623 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 215/430] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:54 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:55.038204 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-50b16750-4077-41cd-b865-c5b271392354 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:55.040052 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-50b16750-4077-41cd-b865-c5b271392354 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:55.050571 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-50b16750-4077-41cd-b865-c5b271392354 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:55.052089 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-50b16750-4077-41cd-b865-c5b271392354 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:55.053911 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-50b16750-4077-41cd-b865-c5b271392354 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:55.056474 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-50b16750-4077-41cd-b865-c5b271392354 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:55.154335 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-50b16750-4077-41cd-b865-c5b271392354 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.121017 Nov 23 14:32:55.155555 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 216/431] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:55 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:55.175814 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9181b875-ad14-47fd-8bb0-a59664769fc2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:55.177483 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9181b875-ad14-47fd-8bb0-a59664769fc2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:55.185468 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9181b875-ad14-47fd-8bb0-a59664769fc2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:55.186264 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9181b875-ad14-47fd-8bb0-a59664769fc2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:55.187330 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9181b875-ad14-47fd-8bb0-a59664769fc2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:55.188078 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9181b875-ad14-47fd-8bb0-a59664769fc2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:55.277619 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9181b875-ad14-47fd-8bb0-a59664769fc2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.105095 Nov 23 14:32:55.285418 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 216/432] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:55 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:55.429671 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d480adcd-8ddc-43d7-8937-c8aac91cab58 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:55.430354 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d480adcd-8ddc-43d7-8937-c8aac91cab58 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:55.438152 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d480adcd-8ddc-43d7-8937-c8aac91cab58 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:55.438927 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d480adcd-8ddc-43d7-8937-c8aac91cab58 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:55.439851 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d480adcd-8ddc-43d7-8937-c8aac91cab58 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:55.440499 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d480adcd-8ddc-43d7-8937-c8aac91cab58 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:55.596821 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-435fec98-a464-4f6f-ad44-08c7da1da737 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:55.598311 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-435fec98-a464-4f6f-ad44-08c7da1da737 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:55.598567 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d480adcd-8ddc-43d7-8937-c8aac91cab58 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:55.608021 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-435fec98-a464-4f6f-ad44-08c7da1da737 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:55.610891 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-435fec98-a464-4f6f-ad44-08c7da1da737 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:55.613585 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-435fec98-a464-4f6f-ad44-08c7da1da737 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:55.615612 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-435fec98-a464-4f6f-ad44-08c7da1da737 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:55.621373 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d480adcd-8ddc-43d7-8937-c8aac91cab58 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1276 microversion: 2.1 time: 0.196421 Nov 23 14:32:55.631578 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 217/433] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:55 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:55.814216 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-435fec98-a464-4f6f-ad44-08c7da1da737 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:55.824322 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-435fec98-a464-4f6f-ad44-08c7da1da737 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1319 microversion: 2.1 time: 0.231373 Nov 23 14:32:55.835020 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 217/434] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:55 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:56.167430 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d717db78-0ddc-48f5-a3ba-2ba4c7195d75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:56.168504 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d717db78-0ddc-48f5-a3ba-2ba4c7195d75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:56.175414 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d717db78-0ddc-48f5-a3ba-2ba4c7195d75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:56.176154 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d717db78-0ddc-48f5-a3ba-2ba4c7195d75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:56.177637 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d717db78-0ddc-48f5-a3ba-2ba4c7195d75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:56.180629 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d717db78-0ddc-48f5-a3ba-2ba4c7195d75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:56.300747 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9841f9ed-cd46-4a5e-adea-c77005ca877f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:56.303801 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9841f9ed-cd46-4a5e-adea-c77005ca877f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:56.311813 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9841f9ed-cd46-4a5e-adea-c77005ca877f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:56.312935 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9841f9ed-cd46-4a5e-adea-c77005ca877f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:56.314544 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9841f9ed-cd46-4a5e-adea-c77005ca877f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:56.315195 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9841f9ed-cd46-4a5e-adea-c77005ca877f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:56.515685 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d717db78-0ddc-48f5-a3ba-2ba4c7195d75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.351828 Nov 23 14:32:56.518162 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 218/435] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:56 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:56.529638 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9841f9ed-cd46-4a5e-adea-c77005ca877f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.235540 Nov 23 14:32:56.531976 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 218/436] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:56 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:32:56.639539 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1c2c5577-0483-4e11-b520-8c7bb2b9f385 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:56.640511 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1c2c5577-0483-4e11-b520-8c7bb2b9f385 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:56.664137 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1c2c5577-0483-4e11-b520-8c7bb2b9f385 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:56.665822 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1c2c5577-0483-4e11-b520-8c7bb2b9f385 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:56.668720 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1c2c5577-0483-4e11-b520-8c7bb2b9f385 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:56.669340 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1c2c5577-0483-4e11-b520-8c7bb2b9f385 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:56.842333 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-808da20f-89b8-4b04-83d9-6fc7aece5bb0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:56.843175 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-808da20f-89b8-4b04-83d9-6fc7aece5bb0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:56.858316 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-808da20f-89b8-4b04-83d9-6fc7aece5bb0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:56.876567 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-808da20f-89b8-4b04-83d9-6fc7aece5bb0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:56.876567 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-808da20f-89b8-4b04-83d9-6fc7aece5bb0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:56.876567 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-808da20f-89b8-4b04-83d9-6fc7aece5bb0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:57.042959 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1c2c5577-0483-4e11-b520-8c7bb2b9f385 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:57.056959 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1c2c5577-0483-4e11-b520-8c7bb2b9f385 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1316 microversion: 2.1 time: 0.420002 Nov 23 14:32:57.067951 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 219/437] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:56 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:57.149817 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-808da20f-89b8-4b04-83d9-6fc7aece5bb0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:57.163354 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-808da20f-89b8-4b04-83d9-6fc7aece5bb0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1319 microversion: 2.1 time: 0.320296 Nov 23 14:32:57.168551 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 219/438] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:56 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:32:57.528937 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-32959de6-a8ce-4a64-93e3-b2d56471bd39 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:57.532682 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-32959de6-a8ce-4a64-93e3-b2d56471bd39 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:57.545039 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8b94a8b9-b188-438e-8295-32fb674f30a9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:57.547608 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8b94a8b9-b188-438e-8295-32fb674f30a9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:57.574538 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-32959de6-a8ce-4a64-93e3-b2d56471bd39 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:57.575013 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-32959de6-a8ce-4a64-93e3-b2d56471bd39 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:57.575828 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-32959de6-a8ce-4a64-93e3-b2d56471bd39 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:57.576783 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8b94a8b9-b188-438e-8295-32fb674f30a9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:57.578161 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8b94a8b9-b188-438e-8295-32fb674f30a9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:57.580402 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-32959de6-a8ce-4a64-93e3-b2d56471bd39 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:57.580833 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8b94a8b9-b188-438e-8295-32fb674f30a9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:57.581427 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8b94a8b9-b188-438e-8295-32fb674f30a9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:57.825903 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-32959de6-a8ce-4a64-93e3-b2d56471bd39 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.300859 Nov 23 14:32:57.827649 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 220/439] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:57 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:57.829407 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8b94a8b9-b188-438e-8295-32fb674f30a9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.289689 Nov 23 14:32:57.830057 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 220/440] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:57 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:32:57.902800 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-ee646ad1-c805-4b1c-bdf0-7c63918c83eb req-81d9d2ca-f37f-48d7-92b4-99f8b8f6ccdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cacec6ec-9dcb-43ce-96fe-15584c509e65", "tag": "6eb8710c-9885-4985-b1fc-07ee28411a7c"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:57.906511 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:32:57.906511 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:32:57.925028 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-ee646ad1-c805-4b1c-bdf0-7c63918c83eb req-81d9d2ca-f37f-48d7-92b4-99f8b8f6ccdc service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:57.925028 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-ee646ad1-c805-4b1c-bdf0-7c63918c83eb req-81d9d2ca-f37f-48d7-92b4-99f8b8f6ccdc service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:57.943007 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-ee646ad1-c805-4b1c-bdf0-7c63918c83eb req-81d9d2ca-f37f-48d7-92b4-99f8b8f6ccdc service nova] Creating event network-changed:6eb8710c-9885-4985-b1fc-07ee28411a7c for instance cacec6ec-9dcb-43ce-96fe-15584c509e65 on hv-cinder-80475 Nov 23 14:32:57.949135 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-ee646ad1-c805-4b1c-bdf0-7c63918c83eb req-81d9d2ca-f37f-48d7-92b4-99f8b8f6ccdc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055002 Nov 23 14:32:57.953473 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 221/441] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:32:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:32:58.075967 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-cc0abc0e-6ac0-4cce-913c-06cb91b600d8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:58.076891 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-cc0abc0e-6ac0-4cce-913c-06cb91b600d8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:58.090391 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cc0abc0e-6ac0-4cce-913c-06cb91b600d8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:58.092196 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cc0abc0e-6ac0-4cce-913c-06cb91b600d8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:58.093027 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cc0abc0e-6ac0-4cce-913c-06cb91b600d8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:58.093467 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cc0abc0e-6ac0-4cce-913c-06cb91b600d8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:58.178761 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7d0740d3-7fb4-4e2d-b128-896cdde3ba41 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:58.179374 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7d0740d3-7fb4-4e2d-b128-896cdde3ba41 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:58.195085 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7d0740d3-7fb4-4e2d-b128-896cdde3ba41 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:58.195537 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7d0740d3-7fb4-4e2d-b128-896cdde3ba41 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:58.196371 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7d0740d3-7fb4-4e2d-b128-896cdde3ba41 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:58.197555 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7d0740d3-7fb4-4e2d-b128-896cdde3ba41 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:58.327937 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-cc0abc0e-6ac0-4cce-913c-06cb91b600d8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:58.335995 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-cc0abc0e-6ac0-4cce-913c-06cb91b600d8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1316 microversion: 2.1 time: 0.264547 Nov 23 14:32:58.338074 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 221/442] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:58 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:58.531747 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7d0740d3-7fb4-4e2d-b128-896cdde3ba41 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:58.560106 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7d0740d3-7fb4-4e2d-b128-896cdde3ba41 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1319 microversion: 2.1 time: 0.382190 Nov 23 14:32:58.560106 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 222/443] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:58 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:58.844390 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e86fc1b2-a5ae-4535-a76f-23f59bc8120f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:58.845558 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e86fc1b2-a5ae-4535-a76f-23f59bc8120f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:58.857169 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8d0ca9b3-804f-4ef9-b5a7-cee92ee313e3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:58.858957 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8d0ca9b3-804f-4ef9-b5a7-cee92ee313e3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:58.860161 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e86fc1b2-a5ae-4535-a76f-23f59bc8120f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:58.860883 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e86fc1b2-a5ae-4535-a76f-23f59bc8120f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:58.861878 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e86fc1b2-a5ae-4535-a76f-23f59bc8120f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:58.862495 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e86fc1b2-a5ae-4535-a76f-23f59bc8120f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:58.870218 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8d0ca9b3-804f-4ef9-b5a7-cee92ee313e3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:58.870900 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8d0ca9b3-804f-4ef9-b5a7-cee92ee313e3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:58.872505 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8d0ca9b3-804f-4ef9-b5a7-cee92ee313e3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:58.873106 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8d0ca9b3-804f-4ef9-b5a7-cee92ee313e3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:59.686060 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8d0ca9b3-804f-4ef9-b5a7-cee92ee313e3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.845110 Nov 23 14:32:59.686949 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 222/444] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:32:58 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:32:59.693173 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-62c0e71e-9910-4f88-a5ce-d30c99e9dd4d req-472eb44d-f2b3-4590-a8fd-6ec0d6b01ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66d63f1e-28e8-4644-a848-e1c1820b86f1", "name": "network-vif-plugged", "status": "completed", "tag": "b583cf1d-49a4-4160-adc2-d5b91008581e"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:32:59.695908 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:32:59.695908 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:32:59.704044 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-62c0e71e-9910-4f88-a5ce-d30c99e9dd4d req-472eb44d-f2b3-4590-a8fd-6ec0d6b01ebb service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:59.704631 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-62c0e71e-9910-4f88-a5ce-d30c99e9dd4d req-472eb44d-f2b3-4590-a8fd-6ec0d6b01ebb service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:59.717199 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-62c0e71e-9910-4f88-a5ce-d30c99e9dd4d req-472eb44d-f2b3-4590-a8fd-6ec0d6b01ebb service nova] Creating event network-vif-plugged:b583cf1d-49a4-4160-adc2-d5b91008581e for instance 66d63f1e-28e8-4644-a848-e1c1820b86f1 on hv-cinder-80475 Nov 23 14:32:59.742027 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-62c0e71e-9910-4f88-a5ce-d30c99e9dd4d req-472eb44d-f2b3-4590-a8fd-6ec0d6b01ebb service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053432 Nov 23 14:32:59.742656 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 223/445] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:32:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:32:59.747698 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b82bdbff-0631-489a-a57c-f74770c2ea50 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:59.748443 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b82bdbff-0631-489a-a57c-f74770c2ea50 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:59.757374 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b82bdbff-0631-489a-a57c-f74770c2ea50 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:59.757374 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b82bdbff-0631-489a-a57c-f74770c2ea50 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:59.757784 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b82bdbff-0631-489a-a57c-f74770c2ea50 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:59.758267 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b82bdbff-0631-489a-a57c-f74770c2ea50 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:59.965221 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-b82bdbff-0631-489a-a57c-f74770c2ea50 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:32:59.972428 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b82bdbff-0631-489a-a57c-f74770c2ea50 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1316 microversion: 2.1 time: 0.228644 Nov 23 14:32:59.972990 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 224/446] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:59 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:32:59.978316 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2c0ff572-053a-4dc1-8015-f67836d3c69d tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:32:59.979027 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2c0ff572-053a-4dc1-8015-f67836d3c69d tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:32:59.984454 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2c0ff572-053a-4dc1-8015-f67836d3c69d tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:59.984907 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2c0ff572-053a-4dc1-8015-f67836d3c69d tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:32:59.985709 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2c0ff572-053a-4dc1-8015-f67836d3c69d tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:32:59.986319 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2c0ff572-053a-4dc1-8015-f67836d3c69d tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:00.070101 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e86fc1b2-a5ae-4535-a76f-23f59bc8120f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 1.228709 Nov 23 14:33:00.073978 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 223/447] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:32:58 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:00.165664 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2c0ff572-053a-4dc1-8015-f67836d3c69d tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:00.177456 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2c0ff572-053a-4dc1-8015-f67836d3c69d tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1319 microversion: 2.1 time: 0.203288 Nov 23 14:33:00.182170 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 225/448] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:32:59 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:00.699492 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-8193ed86-0924-4524-a2dc-24d0b211f1d7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:00.700552 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-8193ed86-0924-4524-a2dc-24d0b211f1d7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:00.707527 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8193ed86-0924-4524-a2dc-24d0b211f1d7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:00.707966 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8193ed86-0924-4524-a2dc-24d0b211f1d7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:00.708768 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8193ed86-0924-4524-a2dc-24d0b211f1d7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:00.709804 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8193ed86-0924-4524-a2dc-24d0b211f1d7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:00.989639 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c18cd75c-fed2-4175-a9e7-f522f6c70c97 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:00.992142 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c18cd75c-fed2-4175-a9e7-f522f6c70c97 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:01.002930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c18cd75c-fed2-4175-a9e7-f522f6c70c97 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:01.003414 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c18cd75c-fed2-4175-a9e7-f522f6c70c97 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:01.004256 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c18cd75c-fed2-4175-a9e7-f522f6c70c97 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:01.004714 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c18cd75c-fed2-4175-a9e7-f522f6c70c97 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:01.034854 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-8193ed86-0924-4524-a2dc-24d0b211f1d7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.339087 Nov 23 14:33:01.035833 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 224/449] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:00 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:01.083894 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-224e492c-1b43-4c6b-9279-03aefc62e369 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:01.085848 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-224e492c-1b43-4c6b-9279-03aefc62e369 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:01.093120 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-224e492c-1b43-4c6b-9279-03aefc62e369 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:01.093761 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-224e492c-1b43-4c6b-9279-03aefc62e369 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:01.094826 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-224e492c-1b43-4c6b-9279-03aefc62e369 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:01.095414 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-224e492c-1b43-4c6b-9279-03aefc62e369 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:01.195180 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c18cd75c-fed2-4175-a9e7-f522f6c70c97 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:01.203271 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c18cd75c-fed2-4175-a9e7-f522f6c70c97 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1316 microversion: 2.1 time: 0.217388 Nov 23 14:33:01.204187 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 226/450] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:00 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:33:01.208968 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-59329bc6-c4f6-48ac-aa92-8d52126c84f4 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:01.209945 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-59329bc6-c4f6-48ac-aa92-8d52126c84f4 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:01.216701 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-59329bc6-c4f6-48ac-aa92-8d52126c84f4 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:01.227026 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-59329bc6-c4f6-48ac-aa92-8d52126c84f4 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:01.229416 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-59329bc6-c4f6-48ac-aa92-8d52126c84f4 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:01.230068 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-59329bc6-c4f6-48ac-aa92-8d52126c84f4 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:01.414194 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-59329bc6-c4f6-48ac-aa92-8d52126c84f4 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:01.423183 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-59329bc6-c4f6-48ac-aa92-8d52126c84f4 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1319 microversion: 2.1 time: 0.217603 Nov 23 14:33:01.424120 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 227/451] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:01 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:01.583916 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ca135ccd-45ea-468d-8e0b-a39c4e6bdd89 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:01.586750 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ca135ccd-45ea-468d-8e0b-a39c4e6bdd89 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:01.593821 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ca135ccd-45ea-468d-8e0b-a39c4e6bdd89 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:01.594376 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ca135ccd-45ea-468d-8e0b-a39c4e6bdd89 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:01.595581 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ca135ccd-45ea-468d-8e0b-a39c4e6bdd89 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:01.596555 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ca135ccd-45ea-468d-8e0b-a39c4e6bdd89 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:01.626690 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-ca135ccd-45ea-468d-8e0b-a39c4e6bdd89 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lazy-loading 'flavor' on Instance uuid 6058aa9c-7bfb-4762-8055-36d2f3e29234 {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:33:01.666302 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-224e492c-1b43-4c6b-9279-03aefc62e369 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.587091 Nov 23 14:33:01.667853 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 225/452] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:01 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:01.975502 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ca135ccd-45ea-468d-8e0b-a39c4e6bdd89 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "POST /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/action" status: 200 len: 32 microversion: 2.1 time: 0.400204 Nov 23 14:33:01.976733 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 228/453] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:01 2021] POST /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/action => generated 32 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 14:33:01.988124 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c27a6a1a-74ff-4f76-bd10-6c452def04f1 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:01.988877 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c27a6a1a-74ff-4f76-bd10-6c452def04f1 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:01.997952 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c27a6a1a-74ff-4f76-bd10-6c452def04f1 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:01.998392 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c27a6a1a-74ff-4f76-bd10-6c452def04f1 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:01.999172 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c27a6a1a-74ff-4f76-bd10-6c452def04f1 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:01.999607 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c27a6a1a-74ff-4f76-bd10-6c452def04f1 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:02.054844 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-cbaac006-4f7b-4e3a-a732-6a3120d7adaa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:02.056167 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-cbaac006-4f7b-4e3a-a732-6a3120d7adaa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:02.068002 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cbaac006-4f7b-4e3a-a732-6a3120d7adaa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:02.068695 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cbaac006-4f7b-4e3a-a732-6a3120d7adaa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:02.070794 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cbaac006-4f7b-4e3a-a732-6a3120d7adaa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:02.072261 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cbaac006-4f7b-4e3a-a732-6a3120d7adaa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:02.198154 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c27a6a1a-74ff-4f76-bd10-6c452def04f1 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:02.214321 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c27a6a1a-74ff-4f76-bd10-6c452def04f1 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1566 microversion: 2.1 time: 0.231865 Nov 23 14:33:02.227872 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 226/454] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:01 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1566 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:02.237511 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-82a7e208-9909-4338-b637-a7ab291e4bf2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:02.245779 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-82a7e208-9909-4338-b637-a7ab291e4bf2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:02.248889 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-82a7e208-9909-4338-b637-a7ab291e4bf2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:02.249615 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-82a7e208-9909-4338-b637-a7ab291e4bf2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:02.250695 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-82a7e208-9909-4338-b637-a7ab291e4bf2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:02.251327 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-82a7e208-9909-4338-b637-a7ab291e4bf2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:02.347125 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-cbaac006-4f7b-4e3a-a732-6a3120d7adaa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.297246 Nov 23 14:33:02.353495 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 229/455] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:02 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:02.442144 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5bb7345e-5083-45c1-8018-afe896e28005 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:02.442888 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5bb7345e-5083-45c1-8018-afe896e28005 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:02.450189 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5bb7345e-5083-45c1-8018-afe896e28005 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:02.450674 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5bb7345e-5083-45c1-8018-afe896e28005 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:02.451537 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5bb7345e-5083-45c1-8018-afe896e28005 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:02.452186 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5bb7345e-5083-45c1-8018-afe896e28005 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:02.495074 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-82a7e208-9909-4338-b637-a7ab291e4bf2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:02.508632 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-82a7e208-9909-4338-b637-a7ab291e4bf2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1316 microversion: 2.1 time: 0.277813 Nov 23 14:33:02.509309 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 227/456] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:02 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:02.611008 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5bb7345e-5083-45c1-8018-afe896e28005 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:02.621676 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5bb7345e-5083-45c1-8018-afe896e28005 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1319 microversion: 2.1 time: 0.182422 Nov 23 14:33:02.622769 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 230/457] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:02 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:33:02.679855 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-32556ff2-32fb-48fb-888a-08455af9c184 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:02.680999 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-32556ff2-32fb-48fb-888a-08455af9c184 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:02.687899 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-32556ff2-32fb-48fb-888a-08455af9c184 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:02.691299 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-32556ff2-32fb-48fb-888a-08455af9c184 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:02.692218 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-32556ff2-32fb-48fb-888a-08455af9c184 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:02.693264 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-32556ff2-32fb-48fb-888a-08455af9c184 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:02.895146 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-32556ff2-32fb-48fb-888a-08455af9c184 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.219709 Nov 23 14:33:02.896102 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 228/458] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:02 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:03.233328 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-fc4b7585-20f6-4118-8ecd-8ccc372bad0e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:03.233948 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-fc4b7585-20f6-4118-8ecd-8ccc372bad0e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:03.240528 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc4b7585-20f6-4118-8ecd-8ccc372bad0e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:03.242148 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc4b7585-20f6-4118-8ecd-8ccc372bad0e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:03.242969 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc4b7585-20f6-4118-8ecd-8ccc372bad0e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:03.243412 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc4b7585-20f6-4118-8ecd-8ccc372bad0e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:03.360929 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-769ccd09-51ab-4990-b87a-e3edae5a5345 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:03.363096 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-769ccd09-51ab-4990-b87a-e3edae5a5345 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:03.402817 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-769ccd09-51ab-4990-b87a-e3edae5a5345 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:03.403385 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-769ccd09-51ab-4990-b87a-e3edae5a5345 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:03.408231 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-769ccd09-51ab-4990-b87a-e3edae5a5345 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:03.408567 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-769ccd09-51ab-4990-b87a-e3edae5a5345 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:03.491679 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-fc4b7585-20f6-4118-8ecd-8ccc372bad0e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:03.504169 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-fc4b7585-20f6-4118-8ecd-8ccc372bad0e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1566 microversion: 2.1 time: 0.274549 Nov 23 14:33:03.504792 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 231/459] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:03 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1566 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:03.514787 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-769ccd09-51ab-4990-b87a-e3edae5a5345 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.157919 Nov 23 14:33:03.515774 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 229/460] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:03 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:33:03.525948 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-fea53cd6-d765-4029-9b40-ff86503cec79 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:03.531564 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-fea53cd6-d765-4029-9b40-ff86503cec79 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:03.532653 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fea53cd6-d765-4029-9b40-ff86503cec79 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:03.533098 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fea53cd6-d765-4029-9b40-ff86503cec79 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:03.533906 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fea53cd6-d765-4029-9b40-ff86503cec79 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:03.534339 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fea53cd6-d765-4029-9b40-ff86503cec79 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:03.639067 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d6a7ec0e-1469-4e5f-be48-161e3295eaef tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:03.639872 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d6a7ec0e-1469-4e5f-be48-161e3295eaef tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:03.646717 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d6a7ec0e-1469-4e5f-be48-161e3295eaef tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:03.647233 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d6a7ec0e-1469-4e5f-be48-161e3295eaef tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:03.648100 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d6a7ec0e-1469-4e5f-be48-161e3295eaef tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:03.648733 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d6a7ec0e-1469-4e5f-be48-161e3295eaef tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:03.675624 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-fea53cd6-d765-4029-9b40-ff86503cec79 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:03.684714 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-fea53cd6-d765-4029-9b40-ff86503cec79 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1316 microversion: 2.1 time: 0.163027 Nov 23 14:33:03.686542 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 232/461] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:03 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:03.801277 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d6a7ec0e-1469-4e5f-be48-161e3295eaef tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:03.810153 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d6a7ec0e-1469-4e5f-be48-161e3295eaef tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1508 microversion: 2.1 time: 0.175075 Nov 23 14:33:03.820116 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 230/462] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:03 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:33:03.910141 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8ab937c4-c050-4af9-b4f4-a3ce39e31036 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:03.911980 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8ab937c4-c050-4af9-b4f4-a3ce39e31036 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:03.926932 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8ab937c4-c050-4af9-b4f4-a3ce39e31036 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:03.927383 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8ab937c4-c050-4af9-b4f4-a3ce39e31036 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:03.928290 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8ab937c4-c050-4af9-b4f4-a3ce39e31036 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:03.928830 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8ab937c4-c050-4af9-b4f4-a3ce39e31036 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:04.527179 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c704d359-8415-4c25-aff2-835a8fcb399a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:04.528342 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c704d359-8415-4c25-aff2-835a8fcb399a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:04.537242 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c704d359-8415-4c25-aff2-835a8fcb399a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:04.538748 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c704d359-8415-4c25-aff2-835a8fcb399a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:04.539969 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c704d359-8415-4c25-aff2-835a8fcb399a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:04.541398 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c704d359-8415-4c25-aff2-835a8fcb399a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:04.721885 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c704d359-8415-4c25-aff2-835a8fcb399a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:04.728821 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c704d359-8415-4c25-aff2-835a8fcb399a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1566 microversion: 2.1 time: 0.210160 Nov 23 14:33:04.729637 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 231/463] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:04 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1566 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:04.734188 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d8624a3e-2fa6-4e6d-92e9-d70e04eef042 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:04.735195 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d8624a3e-2fa6-4e6d-92e9-d70e04eef042 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:04.742509 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d8624a3e-2fa6-4e6d-92e9-d70e04eef042 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:04.742959 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d8624a3e-2fa6-4e6d-92e9-d70e04eef042 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:04.743806 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d8624a3e-2fa6-4e6d-92e9-d70e04eef042 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:04.744270 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d8624a3e-2fa6-4e6d-92e9-d70e04eef042 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:08.851860 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8ab937c4-c050-4af9-b4f4-a3ce39e31036 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 4.945434 Nov 23 14:33:08.852656 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 233/464] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:03 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 4947 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:08.859245 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-34d38f64-4f48-469e-8e08-d3a758496b3b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:08.860040 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-34d38f64-4f48-469e-8e08-d3a758496b3b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:08.867728 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-34d38f64-4f48-469e-8e08-d3a758496b3b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:08.868197 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-34d38f64-4f48-469e-8e08-d3a758496b3b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:08.870360 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-34d38f64-4f48-469e-8e08-d3a758496b3b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:08.870816 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-34d38f64-4f48-469e-8e08-d3a758496b3b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:08.924028 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d8624a3e-2fa6-4e6d-92e9-d70e04eef042 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 4.193129 Nov 23 14:33:08.924715 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 232/465] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:04 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 4195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:08.929848 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-215856ea-c0a2-422b-a05d-69e44f909a88 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:08.930540 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-215856ea-c0a2-422b-a05d-69e44f909a88 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:08.937635 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-215856ea-c0a2-422b-a05d-69e44f909a88 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:08.938228 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-215856ea-c0a2-422b-a05d-69e44f909a88 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:08.939024 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-215856ea-c0a2-422b-a05d-69e44f909a88 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:08.939662 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-215856ea-c0a2-422b-a05d-69e44f909a88 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:09.039523 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-34d38f64-4f48-469e-8e08-d3a758496b3b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:09.052777 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-34d38f64-4f48-469e-8e08-d3a758496b3b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1316 microversion: 2.1 time: 0.193562 Nov 23 14:33:09.053434 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 234/466] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:08 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:09.152829 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-215856ea-c0a2-422b-a05d-69e44f909a88 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:09.160930 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-215856ea-c0a2-422b-a05d-69e44f909a88 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1566 microversion: 2.1 time: 0.235076 Nov 23 14:33:09.163131 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 233/467] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:08 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1566 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:09.864031 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-fe8cc797-cf6e-46bf-bbf6-3dd37575d9da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:09.866241 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-fe8cc797-cf6e-46bf-bbf6-3dd37575d9da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:09.881576 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fe8cc797-cf6e-46bf-bbf6-3dd37575d9da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:09.882132 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fe8cc797-cf6e-46bf-bbf6-3dd37575d9da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:09.882941 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fe8cc797-cf6e-46bf-bbf6-3dd37575d9da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:09.883385 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fe8cc797-cf6e-46bf-bbf6-3dd37575d9da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:09.935019 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c1f68b7d-448c-4030-96ee-abf201f87d32 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:09.938707 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c1f68b7d-448c-4030-96ee-abf201f87d32 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:09.944758 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c1f68b7d-448c-4030-96ee-abf201f87d32 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:09.945636 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c1f68b7d-448c-4030-96ee-abf201f87d32 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:09.947367 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c1f68b7d-448c-4030-96ee-abf201f87d32 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:09.947929 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c1f68b7d-448c-4030-96ee-abf201f87d32 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:10.023227 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-fe8cc797-cf6e-46bf-bbf6-3dd37575d9da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.162835 Nov 23 14:33:10.023915 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 235/468] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:09 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:10.070677 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8a8c1575-2ceb-402c-8dde-1135bbe07874 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:10.071543 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8a8c1575-2ceb-402c-8dde-1135bbe07874 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:10.079303 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8a8c1575-2ceb-402c-8dde-1135bbe07874 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:10.079862 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8a8c1575-2ceb-402c-8dde-1135bbe07874 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:10.080546 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8a8c1575-2ceb-402c-8dde-1135bbe07874 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:10.081234 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8a8c1575-2ceb-402c-8dde-1135bbe07874 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:10.189493 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c1f68b7d-448c-4030-96ee-abf201f87d32 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.257823 Nov 23 14:33:10.190855 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 234/469] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:09 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:10.200076 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-648a31c9-779f-4f31-8126-cb8b216860c4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:10.202080 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-648a31c9-779f-4f31-8126-cb8b216860c4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:10.217342 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-648a31c9-779f-4f31-8126-cb8b216860c4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:10.219323 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-648a31c9-779f-4f31-8126-cb8b216860c4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:10.220993 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-648a31c9-779f-4f31-8126-cb8b216860c4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:10.221777 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-648a31c9-779f-4f31-8126-cb8b216860c4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:10.237276 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-8a8c1575-2ceb-402c-8dde-1135bbe07874 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:10.245701 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8a8c1575-2ceb-402c-8dde-1135bbe07874 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1316 microversion: 2.1 time: 0.179876 Nov 23 14:33:10.246305 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 236/470] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:10 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:10.372759 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-648a31c9-779f-4f31-8126-cb8b216860c4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:10.380827 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-648a31c9-779f-4f31-8126-cb8b216860c4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1566 microversion: 2.1 time: 0.188440 Nov 23 14:33:10.381945 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 235/471] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:10 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:11.034637 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8f73b2b6-eaee-443f-bdd2-bb82c2c11270 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:11.035534 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8f73b2b6-eaee-443f-bdd2-bb82c2c11270 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:11.042039 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8f73b2b6-eaee-443f-bdd2-bb82c2c11270 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:11.042480 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8f73b2b6-eaee-443f-bdd2-bb82c2c11270 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:11.043249 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8f73b2b6-eaee-443f-bdd2-bb82c2c11270 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:11.043705 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8f73b2b6-eaee-443f-bdd2-bb82c2c11270 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:11.122269 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8f73b2b6-eaee-443f-bdd2-bb82c2c11270 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.089162 Nov 23 14:33:11.122269 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 237/472] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:11 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:11.201781 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-870b645e-9a09-4313-bc5e-8dd26a65c287 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:11.206346 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-870b645e-9a09-4313-bc5e-8dd26a65c287 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:11.215279 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-870b645e-9a09-4313-bc5e-8dd26a65c287 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:11.215862 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-870b645e-9a09-4313-bc5e-8dd26a65c287 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:11.216900 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-870b645e-9a09-4313-bc5e-8dd26a65c287 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:11.217578 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-870b645e-9a09-4313-bc5e-8dd26a65c287 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:11.263646 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-17e726ba-86c5-44ec-9866-f6f82d61d997 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:11.264318 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-17e726ba-86c5-44ec-9866-f6f82d61d997 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:11.271653 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-17e726ba-86c5-44ec-9866-f6f82d61d997 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:11.275814 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-17e726ba-86c5-44ec-9866-f6f82d61d997 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:11.275814 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-17e726ba-86c5-44ec-9866-f6f82d61d997 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:11.275814 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-17e726ba-86c5-44ec-9866-f6f82d61d997 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:11.300410 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-870b645e-9a09-4313-bc5e-8dd26a65c287 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.102464 Nov 23 14:33:11.301491 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 236/473] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:11 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:11.418178 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-26e7dd68-a25f-4282-8fb9-3fc80367000b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:11.419080 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-26e7dd68-a25f-4282-8fb9-3fc80367000b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:11.447222 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-26e7dd68-a25f-4282-8fb9-3fc80367000b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:11.448571 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-26e7dd68-a25f-4282-8fb9-3fc80367000b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:11.451667 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-26e7dd68-a25f-4282-8fb9-3fc80367000b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:11.452900 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-26e7dd68-a25f-4282-8fb9-3fc80367000b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:11.458218 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-17e726ba-86c5-44ec-9866-f6f82d61d997 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:11.467908 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-17e726ba-86c5-44ec-9866-f6f82d61d997 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1316 microversion: 2.1 time: 0.208625 Nov 23 14:33:11.479864 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 238/474] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:11 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:11.648116 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-26e7dd68-a25f-4282-8fb9-3fc80367000b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:11.657395 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-26e7dd68-a25f-4282-8fb9-3fc80367000b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1566 microversion: 2.1 time: 0.250730 Nov 23 14:33:11.658825 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 237/475] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:11 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1566 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:12.137642 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b8e06bd6-8ec3-48ba-9cba-6bcd7a6df631 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:12.139275 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b8e06bd6-8ec3-48ba-9cba-6bcd7a6df631 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:12.150635 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b8e06bd6-8ec3-48ba-9cba-6bcd7a6df631 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:12.153950 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b8e06bd6-8ec3-48ba-9cba-6bcd7a6df631 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:12.153950 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b8e06bd6-8ec3-48ba-9cba-6bcd7a6df631 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:12.155190 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b8e06bd6-8ec3-48ba-9cba-6bcd7a6df631 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:12.322955 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-0bc79edd-8174-4498-9d8c-d68596aaf3c6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:12.326695 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-0bc79edd-8174-4498-9d8c-d68596aaf3c6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:12.365696 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0bc79edd-8174-4498-9d8c-d68596aaf3c6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:12.365696 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0bc79edd-8174-4498-9d8c-d68596aaf3c6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:12.365696 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0bc79edd-8174-4498-9d8c-d68596aaf3c6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:12.365696 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0bc79edd-8174-4498-9d8c-d68596aaf3c6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:16.217259 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b8e06bd6-8ec3-48ba-9cba-6bcd7a6df631 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 4.087250 Nov 23 14:33:16.218456 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 239/476] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:12 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 4090 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:33:16.224110 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c1a38aac-621a-447f-b3b0-73df87e108c5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:16.224764 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c1a38aac-621a-447f-b3b0-73df87e108c5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:16.227120 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-0bc79edd-8174-4498-9d8c-d68596aaf3c6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 3.917130 Nov 23 14:33:16.229622 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 238/477] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:12 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 3920 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:33:16.238467 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c1a38aac-621a-447f-b3b0-73df87e108c5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:16.238467 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c1a38aac-621a-447f-b3b0-73df87e108c5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:16.238467 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c1a38aac-621a-447f-b3b0-73df87e108c5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:16.238467 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c1a38aac-621a-447f-b3b0-73df87e108c5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:16.239013 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-fffec4b5-d734-4ae6-843a-1aba988d1fd4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:16.239013 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-fffec4b5-d734-4ae6-843a-1aba988d1fd4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:16.243809 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fffec4b5-d734-4ae6-843a-1aba988d1fd4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:16.244419 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fffec4b5-d734-4ae6-843a-1aba988d1fd4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:16.245408 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fffec4b5-d734-4ae6-843a-1aba988d1fd4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:16.245925 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fffec4b5-d734-4ae6-843a-1aba988d1fd4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:16.390260 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-fffec4b5-d734-4ae6-843a-1aba988d1fd4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:16.402396 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-fffec4b5-d734-4ae6-843a-1aba988d1fd4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1566 microversion: 2.1 time: 0.171308 Nov 23 14:33:16.403306 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 239/478] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:16 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:16.411279 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-f0e7d075-5a79-4fba-9745-a63d416c9a14 req-dde6f2d9-aec1-4a34-8fc0-2d804e1abc60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cacec6ec-9dcb-43ce-96fe-15584c509e65", "name": "network-vif-plugged", "status": "completed", "tag": "6eb8710c-9885-4985-b1fc-07ee28411a7c"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:16.413987 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:33:16.413987 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:33:16.424815 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c1a38aac-621a-447f-b3b0-73df87e108c5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:16.426249 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-f0e7d075-5a79-4fba-9745-a63d416c9a14 req-dde6f2d9-aec1-4a34-8fc0-2d804e1abc60 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:16.426868 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-f0e7d075-5a79-4fba-9745-a63d416c9a14 req-dde6f2d9-aec1-4a34-8fc0-2d804e1abc60 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:16.433261 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c1a38aac-621a-447f-b3b0-73df87e108c5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1316 microversion: 2.1 time: 0.213585 Nov 23 14:33:16.435905 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 240/479] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:16 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:16.446722 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-f0e7d075-5a79-4fba-9745-a63d416c9a14 req-dde6f2d9-aec1-4a34-8fc0-2d804e1abc60 service nova] Creating event network-vif-plugged:6eb8710c-9885-4985-b1fc-07ee28411a7c for instance cacec6ec-9dcb-43ce-96fe-15584c509e65 on hv-cinder-80475 Nov 23 14:33:16.452998 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-f0e7d075-5a79-4fba-9745-a63d416c9a14 req-dde6f2d9-aec1-4a34-8fc0-2d804e1abc60 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047972 Nov 23 14:33:16.454025 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 240/480] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:33:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:33:17.230242 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4ea46d4c-6c3e-4436-a480-22dad82c3581 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:17.231152 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4ea46d4c-6c3e-4436-a480-22dad82c3581 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:17.240400 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4ea46d4c-6c3e-4436-a480-22dad82c3581 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:17.242411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4ea46d4c-6c3e-4436-a480-22dad82c3581 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:17.243504 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4ea46d4c-6c3e-4436-a480-22dad82c3581 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:17.244331 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4ea46d4c-6c3e-4436-a480-22dad82c3581 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:17.249512 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-fb5fa9ad-d653-4d50-8b37-76a03d3c8aac tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:17.250587 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-fb5fa9ad-d653-4d50-8b37-76a03d3c8aac tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:17.292777 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fb5fa9ad-d653-4d50-8b37-76a03d3c8aac tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:17.294959 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fb5fa9ad-d653-4d50-8b37-76a03d3c8aac tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:17.296049 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fb5fa9ad-d653-4d50-8b37-76a03d3c8aac tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:17.299509 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fb5fa9ad-d653-4d50-8b37-76a03d3c8aac tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:17.362461 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4ea46d4c-6c3e-4436-a480-22dad82c3581 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.136199 Nov 23 14:33:17.364425 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 241/481] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:17 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:17.441128 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-fb5fa9ad-d653-4d50-8b37-76a03d3c8aac tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.180478 Nov 23 14:33:17.441128 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 241/482] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:17 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:17.441501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a750205f-d059-418d-8446-dce2cbded2db tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:17.441501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a750205f-d059-418d-8446-dce2cbded2db tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:17.441501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a750205f-d059-418d-8446-dce2cbded2db tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:17.441501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a750205f-d059-418d-8446-dce2cbded2db tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:17.447209 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a750205f-d059-418d-8446-dce2cbded2db tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:17.447721 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a750205f-d059-418d-8446-dce2cbded2db tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:17.515862 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b56d72c3-f28a-455d-84e2-84ad4df1ce8a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:17.515862 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b56d72c3-f28a-455d-84e2-84ad4df1ce8a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:17.520087 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b56d72c3-f28a-455d-84e2-84ad4df1ce8a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:17.525169 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b56d72c3-f28a-455d-84e2-84ad4df1ce8a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:17.526695 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b56d72c3-f28a-455d-84e2-84ad4df1ce8a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:17.529147 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b56d72c3-f28a-455d-84e2-84ad4df1ce8a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:17.685900 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a750205f-d059-418d-8446-dce2cbded2db tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:17.694939 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a750205f-d059-418d-8446-dce2cbded2db tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1566 microversion: 2.1 time: 0.276444 Nov 23 14:33:17.696134 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 242/483] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:17 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1566 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:17.700467 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-b56d72c3-f28a-455d-84e2-84ad4df1ce8a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:17.711854 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b56d72c3-f28a-455d-84e2-84ad4df1ce8a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1316 microversion: 2.1 time: 0.221634 Nov 23 14:33:17.712734 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 242/484] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:17 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:18.379133 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-82af234e-ba8b-4420-ba80-dab1de084baf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:18.380046 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-82af234e-ba8b-4420-ba80-dab1de084baf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:18.387536 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-82af234e-ba8b-4420-ba80-dab1de084baf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:18.387984 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-82af234e-ba8b-4420-ba80-dab1de084baf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:18.388817 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-82af234e-ba8b-4420-ba80-dab1de084baf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:18.389251 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-82af234e-ba8b-4420-ba80-dab1de084baf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:18.437281 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-98a40735-cadb-4990-9d29-cbedbcf20d4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:18.438191 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-98a40735-cadb-4990-9d29-cbedbcf20d4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:18.445367 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-98a40735-cadb-4990-9d29-cbedbcf20d4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:18.446281 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-98a40735-cadb-4990-9d29-cbedbcf20d4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:18.447016 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-98a40735-cadb-4990-9d29-cbedbcf20d4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:18.447451 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-98a40735-cadb-4990-9d29-cbedbcf20d4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:18.500260 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-82af234e-ba8b-4420-ba80-dab1de084baf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.124824 Nov 23 14:33:18.501698 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 243/485] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:18 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:18.715367 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f904006d-e821-4226-9ff6-26d0cac1e201 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:18.715468 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f904006d-e821-4226-9ff6-26d0cac1e201 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:18.722862 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f904006d-e821-4226-9ff6-26d0cac1e201 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:18.725317 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f904006d-e821-4226-9ff6-26d0cac1e201 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:18.727055 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f904006d-e821-4226-9ff6-26d0cac1e201 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:18.727778 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f904006d-e821-4226-9ff6-26d0cac1e201 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:18.732389 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-98a40735-cadb-4990-9d29-cbedbcf20d4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.298043 Nov 23 14:33:18.733256 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 243/486] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:18 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:33:18.739178 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-904bed2f-0a2a-442e-9446-cfd9b9df6566 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:18.745143 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-904bed2f-0a2a-442e-9446-cfd9b9df6566 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:18.755167 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-904bed2f-0a2a-442e-9446-cfd9b9df6566 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:18.756439 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-904bed2f-0a2a-442e-9446-cfd9b9df6566 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:18.758908 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-904bed2f-0a2a-442e-9446-cfd9b9df6566 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:18.759508 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-904bed2f-0a2a-442e-9446-cfd9b9df6566 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:18.920582 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f904006d-e821-4226-9ff6-26d0cac1e201 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:18.930028 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f904006d-e821-4226-9ff6-26d0cac1e201 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1566 microversion: 2.1 time: 0.219587 Nov 23 14:33:18.931090 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 244/487] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:18 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:33:18.947058 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-904bed2f-0a2a-442e-9446-cfd9b9df6566 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:18.960840 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-904bed2f-0a2a-442e-9446-cfd9b9df6566 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1316 microversion: 2.1 time: 0.225631 Nov 23 14:33:18.961775 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 244/488] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:18 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:19.511621 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4aaab255-e9ec-4500-9196-98aca177bf97 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:19.512982 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4aaab255-e9ec-4500-9196-98aca177bf97 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:19.519948 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4aaab255-e9ec-4500-9196-98aca177bf97 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:19.520515 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4aaab255-e9ec-4500-9196-98aca177bf97 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:19.521526 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4aaab255-e9ec-4500-9196-98aca177bf97 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:19.521981 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4aaab255-e9ec-4500-9196-98aca177bf97 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:19.674197 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4aaab255-e9ec-4500-9196-98aca177bf97 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.166397 Nov 23 14:33:19.678255 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 245/489] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:19 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:19.745051 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-375287d5-c949-4647-b6c6-43c4793bf7aa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:19.746000 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-375287d5-c949-4647-b6c6-43c4793bf7aa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:19.753056 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-375287d5-c949-4647-b6c6-43c4793bf7aa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:19.753499 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-375287d5-c949-4647-b6c6-43c4793bf7aa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:19.754498 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-375287d5-c949-4647-b6c6-43c4793bf7aa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:19.754942 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-375287d5-c949-4647-b6c6-43c4793bf7aa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:19.842337 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-375287d5-c949-4647-b6c6-43c4793bf7aa tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.101094 Nov 23 14:33:19.843216 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 245/490] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:19 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:33:19.950822 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e4061816-aa43-464f-b890-6bfbf97a6339 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:19.951999 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e4061816-aa43-464f-b890-6bfbf97a6339 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:19.958748 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e4061816-aa43-464f-b890-6bfbf97a6339 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:19.959210 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e4061816-aa43-464f-b890-6bfbf97a6339 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:19.960016 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e4061816-aa43-464f-b890-6bfbf97a6339 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:19.960462 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e4061816-aa43-464f-b890-6bfbf97a6339 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:19.980567 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a1a4b4a6-5121-43a5-8348-9b571b993627 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:19.981303 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a1a4b4a6-5121-43a5-8348-9b571b993627 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:19.988508 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a1a4b4a6-5121-43a5-8348-9b571b993627 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:19.988952 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a1a4b4a6-5121-43a5-8348-9b571b993627 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:19.989869 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a1a4b4a6-5121-43a5-8348-9b571b993627 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:19.990285 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a1a4b4a6-5121-43a5-8348-9b571b993627 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:20.135564 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e4061816-aa43-464f-b890-6bfbf97a6339 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:20.161122 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e4061816-aa43-464f-b890-6bfbf97a6339 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1566 microversion: 2.1 time: 0.207223 Nov 23 14:33:20.161122 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 246/491] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:19 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1566 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:20.188118 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a1a4b4a6-5121-43a5-8348-9b571b993627 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:20.199013 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a1a4b4a6-5121-43a5-8348-9b571b993627 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1505 microversion: 2.1 time: 0.223633 Nov 23 14:33:20.199626 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 246/492] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:19 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:20.222020 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3014b78f-dc69-4812-955a-8726bb5bde47 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e85d5fc-6b47-4431-bef4-9706cfb15849"}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:20.223358 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3014b78f-dc69-4812-955a-8726bb5bde47 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:20.229881 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3014b78f-dc69-4812-955a-8726bb5bde47 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:20.230336 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3014b78f-dc69-4812-955a-8726bb5bde47 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:20.231129 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3014b78f-dc69-4812-955a-8726bb5bde47 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:20.231565 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3014b78f-dc69-4812-955a-8726bb5bde47 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:20.323288 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-3014b78f-dc69-4812-955a-8726bb5bde47 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] HTTP exception thrown: Invalid volume: volume 3e85d5fc-6b47-4431-bef4-9706cfb15849 is already attached to instances: 43b4442f-25b2-4695-a16f-17263d9e1710 Nov 23 14:33:20.323920 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3014b78f-dc69-4812-955a-8726bb5bde47 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Returning 400 to user: Invalid volume: volume 3e85d5fc-6b47-4431-bef4-9706cfb15849 is already attached to instances: 43b4442f-25b2-4695-a16f-17263d9e1710 {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:33:20.324863 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3014b78f-dc69-4812-955a-8726bb5bde47 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "POST /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107316 Nov 23 14:33:20.329069 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 247/493] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Nov 23 14:33:20 2021] POST /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 14:33:20.439390 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bdbd45f0-45bd-4fa2-8b25-2d21e7a63c59 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:20.439390 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bdbd45f0-45bd-4fa2-8b25-2d21e7a63c59 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:20.440687 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bdbd45f0-45bd-4fa2-8b25-2d21e7a63c59 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:20.441148 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bdbd45f0-45bd-4fa2-8b25-2d21e7a63c59 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:20.441944 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bdbd45f0-45bd-4fa2-8b25-2d21e7a63c59 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:20.442388 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bdbd45f0-45bd-4fa2-8b25-2d21e7a63c59 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:20.617519 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.objects.instance [None req-bdbd45f0-45bd-4fa2-8b25-2d21e7a63c59 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lazy-loading 'services' on Instance uuid 43b4442f-25b2-4695-a16f-17263d9e1710 {{(pid=116788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:33:20.685515 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-acf75010-2d58-4fca-8281-96f3fd365da8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:20.686429 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-acf75010-2d58-4fca-8281-96f3fd365da8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:20.693474 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-acf75010-2d58-4fca-8281-96f3fd365da8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:20.693921 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-acf75010-2d58-4fca-8281-96f3fd365da8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:20.694789 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-acf75010-2d58-4fca-8281-96f3fd365da8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:20.695118 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-acf75010-2d58-4fca-8281-96f3fd365da8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:20.814112 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-acf75010-2d58-4fca-8281-96f3fd365da8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.132005 Nov 23 14:33:20.814988 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 248/494] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:20 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:33:20.860055 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ace6bff1-9092-46a6-b40d-fe91438947ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:20.861170 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ace6bff1-9092-46a6-b40d-fe91438947ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:20.868793 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ace6bff1-9092-46a6-b40d-fe91438947ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:20.875034 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ace6bff1-9092-46a6-b40d-fe91438947ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:20.875034 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ace6bff1-9092-46a6-b40d-fe91438947ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:20.875034 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ace6bff1-9092-46a6-b40d-fe91438947ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:20.951087 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bdbd45f0-45bd-4fa2-8b25-2d21e7a63c59 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "DELETE /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710/os-volume_attachments/3e85d5fc-6b47-4431-bef4-9706cfb15849" status: 202 len: 0 microversion: 2.1 time: 0.522613 Nov 23 14:33:20.952170 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 247/495] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Nov 23 14:33:20 2021] DELETE /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710/os-volume_attachments/3e85d5fc-6b47-4431-bef4-9706cfb15849 => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:20.962081 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-756ba9e6-efe7-4a2f-b366-3dcc13af31dd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:20.963125 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-756ba9e6-efe7-4a2f-b366-3dcc13af31dd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:20.969317 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-756ba9e6-efe7-4a2f-b366-3dcc13af31dd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:20.969755 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-756ba9e6-efe7-4a2f-b366-3dcc13af31dd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:20.970569 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-756ba9e6-efe7-4a2f-b366-3dcc13af31dd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:20.970999 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-756ba9e6-efe7-4a2f-b366-3dcc13af31dd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:20.977816 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ace6bff1-9092-46a6-b40d-fe91438947ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.120827 Nov 23 14:33:20.982413 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 249/496] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:20 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:33:21.007503 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-756ba9e6-efe7-4a2f-b366-3dcc13af31dd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050891 Nov 23 14:33:21.008137 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 248/497] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:33:20 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:33:21.171907 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a5542c8b-a44a-41dd-8561-4a5e0499d4f4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:21.172802 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a5542c8b-a44a-41dd-8561-4a5e0499d4f4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:21.181876 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a5542c8b-a44a-41dd-8561-4a5e0499d4f4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:21.182323 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a5542c8b-a44a-41dd-8561-4a5e0499d4f4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:21.183116 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a5542c8b-a44a-41dd-8561-4a5e0499d4f4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:21.183555 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a5542c8b-a44a-41dd-8561-4a5e0499d4f4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:21.317783 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a5542c8b-a44a-41dd-8561-4a5e0499d4f4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:21.326834 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a5542c8b-a44a-41dd-8561-4a5e0499d4f4 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1566 microversion: 2.1 time: 0.159135 Nov 23 14:33:21.327388 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 250/498] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:21 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:21.825647 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-64e1781a-f131-4f0e-93d6-8a6ebbe3629f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:21.826541 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-64e1781a-f131-4f0e-93d6-8a6ebbe3629f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:21.833047 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-64e1781a-f131-4f0e-93d6-8a6ebbe3629f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:21.833558 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-64e1781a-f131-4f0e-93d6-8a6ebbe3629f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:21.834501 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-64e1781a-f131-4f0e-93d6-8a6ebbe3629f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:21.834971 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-64e1781a-f131-4f0e-93d6-8a6ebbe3629f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:21.911505 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-64e1781a-f131-4f0e-93d6-8a6ebbe3629f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.089207 Nov 23 14:33:21.912426 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 249/499] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:21 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:21.990402 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7f137b84-4bea-4d98-8cb6-8359104493f3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:21.991417 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7f137b84-4bea-4d98-8cb6-8359104493f3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:21.998675 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7f137b84-4bea-4d98-8cb6-8359104493f3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:21.999117 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7f137b84-4bea-4d98-8cb6-8359104493f3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:21.999889 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7f137b84-4bea-4d98-8cb6-8359104493f3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:22.000386 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7f137b84-4bea-4d98-8cb6-8359104493f3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:22.020147 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d0738205-ce6c-49e4-abaf-2a51ea4c7d64 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:22.021683 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d0738205-ce6c-49e4-abaf-2a51ea4c7d64 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:22.029813 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d0738205-ce6c-49e4-abaf-2a51ea4c7d64 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:22.030403 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d0738205-ce6c-49e4-abaf-2a51ea4c7d64 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:22.031480 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d0738205-ce6c-49e4-abaf-2a51ea4c7d64 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:22.031972 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d0738205-ce6c-49e4-abaf-2a51ea4c7d64 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:22.065241 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d0738205-ce6c-49e4-abaf-2a51ea4c7d64 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049425 Nov 23 14:33:22.065787 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 250/500] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:33:22 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:33:22.083439 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7f137b84-4bea-4d98-8cb6-8359104493f3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.096869 Nov 23 14:33:22.084008 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 251/501] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:21 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:22.344491 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e332d53e-81bd-4ec2-bab7-5cf2e9d202ad tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:22.345029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e332d53e-81bd-4ec2-bab7-5cf2e9d202ad tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:22.352812 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e332d53e-81bd-4ec2-bab7-5cf2e9d202ad tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:22.353441 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e332d53e-81bd-4ec2-bab7-5cf2e9d202ad tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:22.356577 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e332d53e-81bd-4ec2-bab7-5cf2e9d202ad tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:22.356577 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e332d53e-81bd-4ec2-bab7-5cf2e9d202ad tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:22.493216 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e332d53e-81bd-4ec2-bab7-5cf2e9d202ad tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:22.502367 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e332d53e-81bd-4ec2-bab7-5cf2e9d202ad tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1566 microversion: 2.1 time: 0.161023 Nov 23 14:33:22.502963 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 251/502] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:22 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:22.924523 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-bc60dc76-b1e8-4522-a67d-9d2a6132385e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:22.925524 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-bc60dc76-b1e8-4522-a67d-9d2a6132385e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:22.934792 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bc60dc76-b1e8-4522-a67d-9d2a6132385e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:22.935240 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bc60dc76-b1e8-4522-a67d-9d2a6132385e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:22.936031 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bc60dc76-b1e8-4522-a67d-9d2a6132385e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:22.936491 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bc60dc76-b1e8-4522-a67d-9d2a6132385e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:23.019583 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-bc60dc76-b1e8-4522-a67d-9d2a6132385e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.099000 Nov 23 14:33:23.020909 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 252/503] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:22 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:23.076431 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b93a9e53-a87f-4e4c-8bdf-d07f122f33a5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:23.077324 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b93a9e53-a87f-4e4c-8bdf-d07f122f33a5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:23.083429 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b93a9e53-a87f-4e4c-8bdf-d07f122f33a5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:23.083874 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b93a9e53-a87f-4e4c-8bdf-d07f122f33a5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:23.084667 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b93a9e53-a87f-4e4c-8bdf-d07f122f33a5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:23.085093 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b93a9e53-a87f-4e4c-8bdf-d07f122f33a5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:23.097995 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5a5dc4f3-ce7c-4044-98a4-8cfcc59c9ca7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:23.098990 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5a5dc4f3-ce7c-4044-98a4-8cfcc59c9ca7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:23.106300 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5a5dc4f3-ce7c-4044-98a4-8cfcc59c9ca7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:23.106749 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5a5dc4f3-ce7c-4044-98a4-8cfcc59c9ca7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:23.107536 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5a5dc4f3-ce7c-4044-98a4-8cfcc59c9ca7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:23.108010 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5a5dc4f3-ce7c-4044-98a4-8cfcc59c9ca7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:23.118563 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b93a9e53-a87f-4e4c-8bdf-d07f122f33a5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045938 Nov 23 14:33:23.119740 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 252/504] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:33:23 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 14:33:23.186307 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5a5dc4f3-ce7c-4044-98a4-8cfcc59c9ca7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.092071 Nov 23 14:33:23.191517 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 253/505] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:23 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:23.343709 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1685bbd0-253a-43bf-b92c-78a3b6cabcac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-202432091", "imageRef": "b06b9241-c147-436d-86bb-7c49ad8ef09c", "flavorRef": "452", "networks": [{"uuid": "91c21480-0f27-4f06-9850-471f208e0ee5"}]}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:23.460260 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.network.neutron [None req-1685bbd0-253a-43bf-b92c-78a3b6cabcac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] validate_networks() for [('91c21480-0f27-4f06-9850-471f208e0ee5', None, None, None, None, None)] {{(pid=116788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:33:23.521238 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-092cdb20-4a36-467d-aac4-860efd602c68 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:23.522060 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-092cdb20-4a36-467d-aac4-860efd602c68 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:23.542696 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-092cdb20-4a36-467d-aac4-860efd602c68 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:23.543254 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-092cdb20-4a36-467d-aac4-860efd602c68 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:23.544400 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-092cdb20-4a36-467d-aac4-860efd602c68 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:23.544985 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-092cdb20-4a36-467d-aac4-860efd602c68 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:23.757898 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-092cdb20-4a36-467d-aac4-860efd602c68 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:23.767911 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-092cdb20-4a36-467d-aac4-860efd602c68 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1566 microversion: 2.1 time: 0.252174 Nov 23 14:33:23.770260 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 254/506] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:23 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1566 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:24.013385 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-1685bbd0-253a-43bf-b92c-78a3b6cabcac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Flavor limits 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:33:24.014109 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-1685bbd0-253a-43bf-b92c-78a3b6cabcac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Image limits 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:33:24.014725 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-1685bbd0-253a-43bf-b92c-78a3b6cabcac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Flavor pref 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:33:24.015133 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-1685bbd0-253a-43bf-b92c-78a3b6cabcac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Image pref 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:33:24.015730 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-1685bbd0-253a-43bf-b92c-78a3b6cabcac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:33:24.024897 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1685bbd0-253a-43bf-b92c-78a3b6cabcac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:24.026316 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1685bbd0-253a-43bf-b92c-78a3b6cabcac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:24.032746 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3327d1e8-c94b-4cbd-8f59-90181ce721ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:24.033798 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3327d1e8-c94b-4cbd-8f59-90181ce721ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:24.039009 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1685bbd0-253a-43bf-b92c-78a3b6cabcac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:24.039597 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1685bbd0-253a-43bf-b92c-78a3b6cabcac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:24.046467 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3327d1e8-c94b-4cbd-8f59-90181ce721ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:24.046925 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3327d1e8-c94b-4cbd-8f59-90181ce721ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:24.047720 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3327d1e8-c94b-4cbd-8f59-90181ce721ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:24.048373 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3327d1e8-c94b-4cbd-8f59-90181ce721ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:24.063271 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-1685bbd0-253a-43bf-b92c-78a3b6cabcac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Getting quotas for project 368da8317e0d4261811a214a941624dc. Resources: {'instances', 'cores', 'ram'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:33:24.067577 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-1685bbd0-253a-43bf-b92c-78a3b6cabcac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Getting quotas for user a5f5f781b89d41e091d59e326a5e4db5 and project 368da8317e0d4261811a214a941624dc. Resources: {'instances', 'cores', 'ram'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:33:24.079886 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1685bbd0-253a-43bf-b92c-78a3b6cabcac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Going to run 1 instances... {{(pid=116788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:33:24.082731 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1685bbd0-253a-43bf-b92c-78a3b6cabcac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b06b9241-c147-436d-86bb-7c49ad8ef09c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:33:24.177450 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3327d1e8-c94b-4cbd-8f59-90181ce721ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.148415 Nov 23 14:33:24.178346 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 255/507] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:24 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:33:24.199186 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-994ce304-db74-4d80-9493-a53b0f56efb3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:24.200702 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-994ce304-db74-4d80-9493-a53b0f56efb3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:24.207763 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-994ce304-db74-4d80-9493-a53b0f56efb3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:24.208208 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-994ce304-db74-4d80-9493-a53b0f56efb3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:24.209020 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-994ce304-db74-4d80-9493-a53b0f56efb3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:24.209456 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-994ce304-db74-4d80-9493-a53b0f56efb3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:24.263340 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1685bbd0-253a-43bf-b92c-78a3b6cabcac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.923849 Nov 23 14:33:24.264268 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 253/508] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:33:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 14:33:24.274020 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a82c45f8-8a86-4eb3-a878-5644b4424f69 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:24.274494 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a82c45f8-8a86-4eb3-a878-5644b4424f69 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:24.292399 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-994ce304-db74-4d80-9493-a53b0f56efb3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.096524 Nov 23 14:33:24.294675 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 256/509] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:24 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:33:24.339492 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a82c45f8-8a86-4eb3-a878-5644b4424f69 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:24.347339 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a82c45f8-8a86-4eb3-a878-5644b4424f69 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1217 microversion: 2.1 time: 0.077395 Nov 23 14:33:24.358016 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 254/510] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:24 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:33:24.792925 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-202d9a99-38a2-4d43-9b90-8f7201b0a12e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:24.793728 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-202d9a99-38a2-4d43-9b90-8f7201b0a12e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:24.800630 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-202d9a99-38a2-4d43-9b90-8f7201b0a12e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:24.801083 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-202d9a99-38a2-4d43-9b90-8f7201b0a12e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:24.809476 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-202d9a99-38a2-4d43-9b90-8f7201b0a12e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:24.810210 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-202d9a99-38a2-4d43-9b90-8f7201b0a12e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:24.951982 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-202d9a99-38a2-4d43-9b90-8f7201b0a12e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:24.963080 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-202d9a99-38a2-4d43-9b90-8f7201b0a12e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1566 microversion: 2.1 time: 0.177097 Nov 23 14:33:24.963080 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 257/511] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:24 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:25.189670 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5432244b-e863-4b44-80c0-8d8814b6fc02 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:25.190684 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5432244b-e863-4b44-80c0-8d8814b6fc02 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:25.199084 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5432244b-e863-4b44-80c0-8d8814b6fc02 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:25.199554 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5432244b-e863-4b44-80c0-8d8814b6fc02 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:25.200436 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5432244b-e863-4b44-80c0-8d8814b6fc02 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:25.200862 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5432244b-e863-4b44-80c0-8d8814b6fc02 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:25.304167 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ccd005a1-e738-4794-b9ce-610d5faaccff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:25.305093 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ccd005a1-e738-4794-b9ce-610d5faaccff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:25.311787 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ccd005a1-e738-4794-b9ce-610d5faaccff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:25.312253 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ccd005a1-e738-4794-b9ce-610d5faaccff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:25.313039 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ccd005a1-e738-4794-b9ce-610d5faaccff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:25.315714 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ccd005a1-e738-4794-b9ce-610d5faaccff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:30.164176 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5432244b-e863-4b44-80c0-8d8814b6fc02 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 4.978002 Nov 23 14:33:30.171418 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ccd005a1-e738-4794-b9ce-610d5faaccff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 4.870852 Nov 23 14:33:30.172146 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 258/512] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:25 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 4872 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:33:30.173128 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 255/513] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:25 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 4988 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:30.182667 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-132943b9-1459-4d3b-9a61-210a295133df tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:30.183354 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-132943b9-1459-4d3b-9a61-210a295133df tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:30.193028 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f2710699-929a-49f2-9a07-442125405597 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:30.193028 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f2710699-929a-49f2-9a07-442125405597 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:30.193294 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-132943b9-1459-4d3b-9a61-210a295133df tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:30.193294 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-132943b9-1459-4d3b-9a61-210a295133df tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:30.193294 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-132943b9-1459-4d3b-9a61-210a295133df tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:30.193556 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-132943b9-1459-4d3b-9a61-210a295133df tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:30.203266 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f2710699-929a-49f2-9a07-442125405597 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:30.203727 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f2710699-929a-49f2-9a07-442125405597 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:30.204618 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f2710699-929a-49f2-9a07-442125405597 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:30.205044 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f2710699-929a-49f2-9a07-442125405597 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:30.276003 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f2710699-929a-49f2-9a07-442125405597 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:30.284941 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f2710699-929a-49f2-9a07-442125405597 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1221 microversion: 2.1 time: 0.108372 Nov 23 14:33:30.285511 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 259/514] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:30 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1221 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:30.354092 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-132943b9-1459-4d3b-9a61-210a295133df tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:30.362368 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-132943b9-1459-4d3b-9a61-210a295133df tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1566 microversion: 2.1 time: 0.187845 Nov 23 14:33:30.362926 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 256/515] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:30 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:31.177278 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-909617bc-5d83-4541-ab21-0791992e0d1b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:31.179420 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-909617bc-5d83-4541-ab21-0791992e0d1b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:31.184712 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6819b6aa-7415-49e0-b8f9-49a90f8e4301 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:31.185831 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-909617bc-5d83-4541-ab21-0791992e0d1b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:31.186269 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6819b6aa-7415-49e0-b8f9-49a90f8e4301 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:31.186394 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-909617bc-5d83-4541-ab21-0791992e0d1b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:31.187069 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-909617bc-5d83-4541-ab21-0791992e0d1b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:31.187515 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-909617bc-5d83-4541-ab21-0791992e0d1b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:31.193368 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6819b6aa-7415-49e0-b8f9-49a90f8e4301 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:31.193817 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6819b6aa-7415-49e0-b8f9-49a90f8e4301 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:31.194608 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6819b6aa-7415-49e0-b8f9-49a90f8e4301 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:31.195036 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6819b6aa-7415-49e0-b8f9-49a90f8e4301 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:31.327031 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6819b6aa-7415-49e0-b8f9-49a90f8e4301 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.147167 Nov 23 14:33:31.328263 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 257/516] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:31 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:31.331240 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-909617bc-5d83-4541-ab21-0791992e0d1b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.158072 Nov 23 14:33:31.332353 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 260/517] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:31 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:31.333800 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9a3d6754-2b2f-4ccd-959c-b80dcdae5f67 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:31.334495 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9a3d6754-2b2f-4ccd-959c-b80dcdae5f67 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:31.341522 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9a3d6754-2b2f-4ccd-959c-b80dcdae5f67 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:31.341966 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9a3d6754-2b2f-4ccd-959c-b80dcdae5f67 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:31.342899 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9a3d6754-2b2f-4ccd-959c-b80dcdae5f67 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:31.343506 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9a3d6754-2b2f-4ccd-959c-b80dcdae5f67 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:31.381374 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7e0d7422-4d4e-45af-b3b9-a95ed72a369b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:31.382061 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7e0d7422-4d4e-45af-b3b9-a95ed72a369b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:31.390418 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7e0d7422-4d4e-45af-b3b9-a95ed72a369b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:31.390889 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7e0d7422-4d4e-45af-b3b9-a95ed72a369b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:31.391850 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7e0d7422-4d4e-45af-b3b9-a95ed72a369b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:31.392460 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7e0d7422-4d4e-45af-b3b9-a95ed72a369b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:31.427960 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9a3d6754-2b2f-4ccd-959c-b80dcdae5f67 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:31.435688 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9a3d6754-2b2f-4ccd-959c-b80dcdae5f67 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1269 microversion: 2.1 time: 0.106054 Nov 23 14:33:31.436284 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 258/518] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:31 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1269 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:31.539830 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7e0d7422-4d4e-45af-b3b9-a95ed72a369b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:31.548106 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7e0d7422-4d4e-45af-b3b9-a95ed72a369b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1566 microversion: 2.1 time: 0.171024 Nov 23 14:33:31.548702 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 261/519] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:31 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:32.345432 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ad18caf5-e657-485e-bce0-3fca9cc2b69a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:32.346409 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b7d3c4f2-f79e-49c8-8851-8aab4f5b36ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:32.347914 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b7d3c4f2-f79e-49c8-8851-8aab4f5b36ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:32.348880 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ad18caf5-e657-485e-bce0-3fca9cc2b69a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:32.373253 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b7d3c4f2-f79e-49c8-8851-8aab4f5b36ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:32.373713 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b7d3c4f2-f79e-49c8-8851-8aab4f5b36ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:32.374521 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b7d3c4f2-f79e-49c8-8851-8aab4f5b36ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:32.375009 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b7d3c4f2-f79e-49c8-8851-8aab4f5b36ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:32.375344 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ad18caf5-e657-485e-bce0-3fca9cc2b69a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:32.376137 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ad18caf5-e657-485e-bce0-3fca9cc2b69a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:32.377157 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ad18caf5-e657-485e-bce0-3fca9cc2b69a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:32.377746 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ad18caf5-e657-485e-bce0-3fca9cc2b69a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:32.489468 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ad18caf5-e657-485e-bce0-3fca9cc2b69a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.154225 Nov 23 14:33:32.491112 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 259/520] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:32 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:32.495913 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6ad0e07a-ba8b-468c-aae2-9e9c60fc7b12 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:32.497206 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6ad0e07a-ba8b-468c-aae2-9e9c60fc7b12 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:32.506083 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b7d3c4f2-f79e-49c8-8851-8aab4f5b36ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.165929 Nov 23 14:33:32.508069 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 262/521] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:32 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:33:32.516098 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6ad0e07a-ba8b-468c-aae2-9e9c60fc7b12 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:32.516098 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6ad0e07a-ba8b-468c-aae2-9e9c60fc7b12 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:32.517647 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6ad0e07a-ba8b-468c-aae2-9e9c60fc7b12 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:32.519025 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6ad0e07a-ba8b-468c-aae2-9e9c60fc7b12 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:32.567641 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9fc675e4-e41b-438b-8847-f307f223f262 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:32.568814 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9fc675e4-e41b-438b-8847-f307f223f262 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:32.577686 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9fc675e4-e41b-438b-8847-f307f223f262 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:32.578128 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9fc675e4-e41b-438b-8847-f307f223f262 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:32.579093 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9fc675e4-e41b-438b-8847-f307f223f262 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:32.579683 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9fc675e4-e41b-438b-8847-f307f223f262 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:32.626995 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6ad0e07a-ba8b-468c-aae2-9e9c60fc7b12 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:32.634242 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6ad0e07a-ba8b-468c-aae2-9e9c60fc7b12 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1275 microversion: 2.1 time: 0.142841 Nov 23 14:33:32.635413 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 260/522] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:32 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1275 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:32.782030 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9fc675e4-e41b-438b-8847-f307f223f262 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:32.792051 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9fc675e4-e41b-438b-8847-f307f223f262 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1546 microversion: 2.1 time: 0.227412 Nov 23 14:33:32.793028 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 263/523] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:32 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1546 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:32.808993 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-53190545-4613-4368-a870-fe4e00b3b908 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:32.809476 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-53190545-4613-4368-a870-fe4e00b3b908 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:32.815751 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-53190545-4613-4368-a870-fe4e00b3b908 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:32.816195 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-53190545-4613-4368-a870-fe4e00b3b908 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:32.819639 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-53190545-4613-4368-a870-fe4e00b3b908 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:32.819639 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-53190545-4613-4368-a870-fe4e00b3b908 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:32.983073 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-53190545-4613-4368-a870-fe4e00b3b908 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] HTTP exception thrown: Cannot 'detach_volume' instance 6058aa9c-7bfb-4762-8055-36d2f3e29234 while it is in vm_state rescued Nov 23 14:33:32.983850 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-53190545-4613-4368-a870-fe4e00b3b908 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Returning 409 to user: Cannot 'detach_volume' instance 6058aa9c-7bfb-4762-8055-36d2f3e29234 while it is in vm_state rescued {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:33:32.984901 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-53190545-4613-4368-a870-fe4e00b3b908 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "DELETE /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/os-volume_attachments/a66132b0-c23d-4f0d-b1c7-9cf437531575" status: 409 len: 152 microversion: 2.1 time: 0.180423 Nov 23 14:33:32.986304 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 261/524] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Nov 23 14:33:32 2021] DELETE /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/os-volume_attachments/a66132b0-c23d-4f0d-b1c7-9cf437531575 => generated 152 bytes in 182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 23 14:33:32.994423 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-000c30b1-9375-43ce-83f1-4873d048ddf9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:32.997213 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-000c30b1-9375-43ce-83f1-4873d048ddf9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:33.007085 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-000c30b1-9375-43ce-83f1-4873d048ddf9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:33.011485 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-000c30b1-9375-43ce-83f1-4873d048ddf9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:33.011485 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-000c30b1-9375-43ce-83f1-4873d048ddf9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:33.011485 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-000c30b1-9375-43ce-83f1-4873d048ddf9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:33.311587 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-000c30b1-9375-43ce-83f1-4873d048ddf9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "POST /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/action" status: 202 len: 0 microversion: 2.1 time: 0.320935 Nov 23 14:33:33.312511 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 264/525] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:32 2021] POST /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:33.320402 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-81cc3fa1-7807-4927-80c3-7842934ca505 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:33.321172 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-81cc3fa1-7807-4927-80c3-7842934ca505 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:33.328766 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-81cc3fa1-7807-4927-80c3-7842934ca505 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:33.331337 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-81cc3fa1-7807-4927-80c3-7842934ca505 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:33.331337 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-81cc3fa1-7807-4927-80c3-7842934ca505 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:33.331337 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-81cc3fa1-7807-4927-80c3-7842934ca505 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:33.503459 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-29c3b8d1-e047-4786-a44a-57bf0c5b7f1e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:33.504457 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-29c3b8d1-e047-4786-a44a-57bf0c5b7f1e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:33.511232 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-29c3b8d1-e047-4786-a44a-57bf0c5b7f1e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:33.511679 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-29c3b8d1-e047-4786-a44a-57bf0c5b7f1e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:33.512498 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-29c3b8d1-e047-4786-a44a-57bf0c5b7f1e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:33.512939 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-29c3b8d1-e047-4786-a44a-57bf0c5b7f1e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:33.570312 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-81cc3fa1-7807-4927-80c3-7842934ca505 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:33.585699 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-81cc3fa1-7807-4927-80c3-7842934ca505 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1554 microversion: 2.1 time: 0.268763 Nov 23 14:33:33.585986 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-29c3b8d1-e047-4786-a44a-57bf0c5b7f1e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.086057 Nov 23 14:33:33.589734 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 262/527] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:33 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1554 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:33.592158 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 265/527] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:33 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:33:33.599394 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-10c6d7b2-78a5-4fdc-81f4-1272c7c79fa0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:33.600611 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-10c6d7b2-78a5-4fdc-81f4-1272c7c79fa0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:33.607564 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-10c6d7b2-78a5-4fdc-81f4-1272c7c79fa0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:33.608320 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-10c6d7b2-78a5-4fdc-81f4-1272c7c79fa0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:33.609283 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-10c6d7b2-78a5-4fdc-81f4-1272c7c79fa0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:33.609721 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-10c6d7b2-78a5-4fdc-81f4-1272c7c79fa0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:33.652530 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-760918ab-ae82-41b3-a33c-f9bbfa4c762e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:33.657630 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-760918ab-ae82-41b3-a33c-f9bbfa4c762e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:33.660644 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-760918ab-ae82-41b3-a33c-f9bbfa4c762e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:33.661301 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-760918ab-ae82-41b3-a33c-f9bbfa4c762e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:33.662084 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-760918ab-ae82-41b3-a33c-f9bbfa4c762e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:33.662818 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-760918ab-ae82-41b3-a33c-f9bbfa4c762e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:33.708479 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-10c6d7b2-78a5-4fdc-81f4-1272c7c79fa0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.112540 Nov 23 14:33:33.713536 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 263/528] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:33 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:33.896932 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-760918ab-ae82-41b3-a33c-f9bbfa4c762e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:33.905763 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-760918ab-ae82-41b3-a33c-f9bbfa4c762e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1317 microversion: 2.1 time: 0.257488 Nov 23 14:33:33.915634 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 266/529] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:33 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:33:34.169989 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-c03c8801-0166-4280-8fc2-2284e1e6755e req-1a22380e-2590-4535-84c1-a465e639d5bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c214697-d673-4304-b403-6624296f8ef2", "tag": "33c40c31-9d6e-4241-9de7-e23035380d49"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:34.171652 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:33:34.171652 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:33:34.189070 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-c03c8801-0166-4280-8fc2-2284e1e6755e req-1a22380e-2590-4535-84c1-a465e639d5bf service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:34.189656 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-c03c8801-0166-4280-8fc2-2284e1e6755e req-1a22380e-2590-4535-84c1-a465e639d5bf service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:34.201764 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-c03c8801-0166-4280-8fc2-2284e1e6755e req-1a22380e-2590-4535-84c1-a465e639d5bf service nova] Creating event network-changed:33c40c31-9d6e-4241-9de7-e23035380d49 for instance 1c214697-d673-4304-b403-6624296f8ef2 on hv-cinder-80475 Nov 23 14:33:34.206639 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-c03c8801-0166-4280-8fc2-2284e1e6755e req-1a22380e-2590-4535-84c1-a465e639d5bf service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041970 Nov 23 14:33:34.207581 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 264/530] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:33:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:33:34.598037 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4f19c179-180f-4e5d-a5de-dbe374d29287 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:34.598973 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4f19c179-180f-4e5d-a5de-dbe374d29287 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:34.604313 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-dcd94644-983c-4636-803e-1f4c7a215e1b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:34.604995 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-dcd94644-983c-4636-803e-1f4c7a215e1b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:34.608284 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4f19c179-180f-4e5d-a5de-dbe374d29287 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:34.609155 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4f19c179-180f-4e5d-a5de-dbe374d29287 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:34.610121 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4f19c179-180f-4e5d-a5de-dbe374d29287 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:34.610721 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4f19c179-180f-4e5d-a5de-dbe374d29287 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:34.611038 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dcd94644-983c-4636-803e-1f4c7a215e1b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:34.611483 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dcd94644-983c-4636-803e-1f4c7a215e1b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:34.612280 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dcd94644-983c-4636-803e-1f4c7a215e1b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:34.612713 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dcd94644-983c-4636-803e-1f4c7a215e1b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:34.700968 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4f19c179-180f-4e5d-a5de-dbe374d29287 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.106493 Nov 23 14:33:34.701619 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 267/531] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:34 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:34.723886 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-67c28d57-3fb8-411c-bf76-ba2ada240b71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:34.729929 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-67c28d57-3fb8-411c-bf76-ba2ada240b71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:34.740200 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-67c28d57-3fb8-411c-bf76-ba2ada240b71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:34.741649 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-67c28d57-3fb8-411c-bf76-ba2ada240b71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:34.742731 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-67c28d57-3fb8-411c-bf76-ba2ada240b71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:34.743650 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-67c28d57-3fb8-411c-bf76-ba2ada240b71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:34.770419 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-dcd94644-983c-4636-803e-1f4c7a215e1b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:34.780857 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-dcd94644-983c-4636-803e-1f4c7a215e1b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1554 microversion: 2.1 time: 0.181675 Nov 23 14:33:34.791948 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 265/532] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:34 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:33:34.828511 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-67c28d57-3fb8-411c-bf76-ba2ada240b71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.110116 Nov 23 14:33:34.832377 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 268/533] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:34 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:33:34.923823 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-671ec17d-cdcd-4cd5-aeb4-37b7d507e96a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:34.924615 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-671ec17d-cdcd-4cd5-aeb4-37b7d507e96a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:34.932007 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-671ec17d-cdcd-4cd5-aeb4-37b7d507e96a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:34.932562 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-671ec17d-cdcd-4cd5-aeb4-37b7d507e96a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:34.933431 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-671ec17d-cdcd-4cd5-aeb4-37b7d507e96a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:34.934229 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-671ec17d-cdcd-4cd5-aeb4-37b7d507e96a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:35.089892 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-671ec17d-cdcd-4cd5-aeb4-37b7d507e96a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:35.098009 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-671ec17d-cdcd-4cd5-aeb4-37b7d507e96a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1317 microversion: 2.1 time: 0.177937 Nov 23 14:33:35.098998 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 266/534] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:34 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:33:35.715156 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-baa489e6-9afb-4567-a9bb-d8de181b4d75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:35.716141 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-baa489e6-9afb-4567-a9bb-d8de181b4d75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:35.723282 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-baa489e6-9afb-4567-a9bb-d8de181b4d75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:35.723727 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-baa489e6-9afb-4567-a9bb-d8de181b4d75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:35.724526 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-baa489e6-9afb-4567-a9bb-d8de181b4d75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:35.724963 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-baa489e6-9afb-4567-a9bb-d8de181b4d75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:35.798732 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-43f3a6d6-4b72-441e-82a7-bd981ec50d6c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:35.800230 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-43f3a6d6-4b72-441e-82a7-bd981ec50d6c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:35.803452 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-baa489e6-9afb-4567-a9bb-d8de181b4d75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.092869 Nov 23 14:33:35.804413 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 269/535] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:35 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:33:35.808289 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-43f3a6d6-4b72-441e-82a7-bd981ec50d6c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:35.808289 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-43f3a6d6-4b72-441e-82a7-bd981ec50d6c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:35.808899 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-43f3a6d6-4b72-441e-82a7-bd981ec50d6c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:35.809318 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-43f3a6d6-4b72-441e-82a7-bd981ec50d6c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:35.853096 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-77531e83-4c22-41af-87e6-53cf76bf7d90 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:35.854480 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-77531e83-4c22-41af-87e6-53cf76bf7d90 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:35.862263 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-77531e83-4c22-41af-87e6-53cf76bf7d90 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:35.862848 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-77531e83-4c22-41af-87e6-53cf76bf7d90 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:35.863911 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-77531e83-4c22-41af-87e6-53cf76bf7d90 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:35.864455 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-77531e83-4c22-41af-87e6-53cf76bf7d90 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:35.970983 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-43f3a6d6-4b72-441e-82a7-bd981ec50d6c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:35.988217 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-43f3a6d6-4b72-441e-82a7-bd981ec50d6c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1554 microversion: 2.1 time: 0.193100 Nov 23 14:33:35.990098 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 267/536] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:35 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:33:36.000487 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-77531e83-4c22-41af-87e6-53cf76bf7d90 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.156892 Nov 23 14:33:36.000487 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 270/537] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:35 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:36.115054 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1ce938b0-0464-4ab6-91c8-d3cc03a5c694 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:36.115660 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1ce938b0-0464-4ab6-91c8-d3cc03a5c694 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:36.122248 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1ce938b0-0464-4ab6-91c8-d3cc03a5c694 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:36.122686 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1ce938b0-0464-4ab6-91c8-d3cc03a5c694 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:36.123632 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1ce938b0-0464-4ab6-91c8-d3cc03a5c694 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:36.124733 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1ce938b0-0464-4ab6-91c8-d3cc03a5c694 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:36.260630 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1ce938b0-0464-4ab6-91c8-d3cc03a5c694 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:36.267818 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1ce938b0-0464-4ab6-91c8-d3cc03a5c694 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1317 microversion: 2.1 time: 0.156851 Nov 23 14:33:36.268408 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 268/538] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:36 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:36.815322 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-605f8243-3573-491d-bee1-c4e4623439d4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:36.816337 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-605f8243-3573-491d-bee1-c4e4623439d4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:36.823230 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-605f8243-3573-491d-bee1-c4e4623439d4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:36.823682 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-605f8243-3573-491d-bee1-c4e4623439d4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:36.824484 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-605f8243-3573-491d-bee1-c4e4623439d4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:36.824919 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-605f8243-3573-491d-bee1-c4e4623439d4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:36.894781 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-605f8243-3573-491d-bee1-c4e4623439d4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.083181 Nov 23 14:33:36.895349 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 271/539] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:36 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:37.006808 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ac714cc0-231f-4249-b5fb-4d8df8d8076c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:37.008325 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ac714cc0-231f-4249-b5fb-4d8df8d8076c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:37.015610 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ac714cc0-231f-4249-b5fb-4d8df8d8076c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:37.016065 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ac714cc0-231f-4249-b5fb-4d8df8d8076c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:37.016903 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ac714cc0-231f-4249-b5fb-4d8df8d8076c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:37.017344 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ac714cc0-231f-4249-b5fb-4d8df8d8076c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:37.022586 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0ef12f29-a27a-446d-8256-9d51440adb0f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:37.023306 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0ef12f29-a27a-446d-8256-9d51440adb0f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:37.034688 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0ef12f29-a27a-446d-8256-9d51440adb0f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:37.035140 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0ef12f29-a27a-446d-8256-9d51440adb0f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:37.035923 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0ef12f29-a27a-446d-8256-9d51440adb0f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:37.036377 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0ef12f29-a27a-446d-8256-9d51440adb0f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:37.097938 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ac714cc0-231f-4249-b5fb-4d8df8d8076c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.094509 Nov 23 14:33:37.100010 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 269/540] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:37 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:37.177517 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0ef12f29-a27a-446d-8256-9d51440adb0f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:37.185970 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0ef12f29-a27a-446d-8256-9d51440adb0f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1554 microversion: 2.1 time: 0.169010 Nov 23 14:33:37.190394 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 272/541] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:37 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:37.286017 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-999d1aa3-10d5-4853-a90c-9524c05d5517 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:37.286709 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-999d1aa3-10d5-4853-a90c-9524c05d5517 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:37.294592 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-999d1aa3-10d5-4853-a90c-9524c05d5517 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:37.295106 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-999d1aa3-10d5-4853-a90c-9524c05d5517 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:37.295876 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-999d1aa3-10d5-4853-a90c-9524c05d5517 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:37.296350 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-999d1aa3-10d5-4853-a90c-9524c05d5517 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:37.431122 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-999d1aa3-10d5-4853-a90c-9524c05d5517 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:37.439074 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-999d1aa3-10d5-4853-a90c-9524c05d5517 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1317 microversion: 2.1 time: 0.157130 Nov 23 14:33:37.439637 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 270/542] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:37 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:37.907279 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0b50005e-a26b-4125-98b2-53610e04db75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:37.916159 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0b50005e-a26b-4125-98b2-53610e04db75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:37.923729 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0b50005e-a26b-4125-98b2-53610e04db75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:37.924195 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0b50005e-a26b-4125-98b2-53610e04db75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:37.925098 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0b50005e-a26b-4125-98b2-53610e04db75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:37.925718 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0b50005e-a26b-4125-98b2-53610e04db75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:38.014660 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0b50005e-a26b-4125-98b2-53610e04db75 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.111963 Nov 23 14:33:38.015315 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 273/543] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:37 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:38.110698 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-52570753-b01c-48a3-8d3d-94316e62fe36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:38.111603 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-52570753-b01c-48a3-8d3d-94316e62fe36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:38.118915 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-52570753-b01c-48a3-8d3d-94316e62fe36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:38.119540 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-52570753-b01c-48a3-8d3d-94316e62fe36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:38.120359 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-52570753-b01c-48a3-8d3d-94316e62fe36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:38.120631 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-52570753-b01c-48a3-8d3d-94316e62fe36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:38.199362 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-52570753-b01c-48a3-8d3d-94316e62fe36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.092134 Nov 23 14:33:38.200713 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 271/544] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:38 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:33:38.209720 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-bbcc5e9e-0fbc-4663-aaa2-bd24704f77e2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:38.222210 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-bbcc5e9e-0fbc-4663-aaa2-bd24704f77e2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:38.222210 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bbcc5e9e-0fbc-4663-aaa2-bd24704f77e2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:38.222210 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bbcc5e9e-0fbc-4663-aaa2-bd24704f77e2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:38.223870 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bbcc5e9e-0fbc-4663-aaa2-bd24704f77e2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:38.224486 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bbcc5e9e-0fbc-4663-aaa2-bd24704f77e2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:38.373844 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-bbcc5e9e-0fbc-4663-aaa2-bd24704f77e2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:38.391538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-bbcc5e9e-0fbc-4663-aaa2-bd24704f77e2 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1560 microversion: 2.1 time: 0.182685 Nov 23 14:33:38.391538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 274/545] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:38 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:33:38.456409 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-4aeb4354-4071-4c30-82c5-5785636bbacd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:38.457036 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-4aeb4354-4071-4c30-82c5-5785636bbacd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:38.465091 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4aeb4354-4071-4c30-82c5-5785636bbacd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:38.468834 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4aeb4354-4071-4c30-82c5-5785636bbacd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:38.468834 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4aeb4354-4071-4c30-82c5-5785636bbacd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:38.468834 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4aeb4354-4071-4c30-82c5-5785636bbacd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:38.490355 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f94a0eaa-6297-4dd7-af36-a995d1cb7697 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:38.492898 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f94a0eaa-6297-4dd7-af36-a995d1cb7697 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:38.503250 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f94a0eaa-6297-4dd7-af36-a995d1cb7697 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:38.516225 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f94a0eaa-6297-4dd7-af36-a995d1cb7697 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:38.517369 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f94a0eaa-6297-4dd7-af36-a995d1cb7697 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:38.517967 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f94a0eaa-6297-4dd7-af36-a995d1cb7697 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:38.660005 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-4aeb4354-4071-4c30-82c5-5785636bbacd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:38.677130 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-4aeb4354-4071-4c30-82c5-5785636bbacd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1317 microversion: 2.1 time: 0.216439 Nov 23 14:33:38.679073 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 272/546] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:38 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:38.702101 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-f94a0eaa-6297-4dd7-af36-a995d1cb7697 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lazy-loading 'services' on Instance uuid 6058aa9c-7bfb-4762-8055-36d2f3e29234 {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:33:39.015064 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f94a0eaa-6297-4dd7-af36-a995d1cb7697 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "DELETE /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/os-volume_attachments/a66132b0-c23d-4f0d-b1c7-9cf437531575" status: 202 len: 0 microversion: 2.1 time: 0.528112 Nov 23 14:33:39.017006 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 275/547] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Nov 23 14:33:38 2021] DELETE /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/os-volume_attachments/a66132b0-c23d-4f0d-b1c7-9cf437531575 => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:39.029710 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-adb41476-2b42-4a16-b1ee-23253109d756 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:39.031048 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-adb41476-2b42-4a16-b1ee-23253109d756 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:39.042191 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-adb41476-2b42-4a16-b1ee-23253109d756 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:39.044679 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-adb41476-2b42-4a16-b1ee-23253109d756 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:39.052105 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-adb41476-2b42-4a16-b1ee-23253109d756 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:39.052760 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b7c08474-8ab2-49a3-9af2-469cae6b8f27 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:39.052850 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-adb41476-2b42-4a16-b1ee-23253109d756 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:39.052932 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b7c08474-8ab2-49a3-9af2-469cae6b8f27 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:39.060012 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b7c08474-8ab2-49a3-9af2-469cae6b8f27 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:39.060557 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b7c08474-8ab2-49a3-9af2-469cae6b8f27 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:39.069117 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b7c08474-8ab2-49a3-9af2-469cae6b8f27 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:39.069654 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b7c08474-8ab2-49a3-9af2-469cae6b8f27 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:39.099034 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-adb41476-2b42-4a16-b1ee-23253109d756 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078124 Nov 23 14:33:39.099605 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 273/548] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:33:39 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:33:39.142222 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b7c08474-8ab2-49a3-9af2-469cae6b8f27 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.106064 Nov 23 14:33:39.144014 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 276/549] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:39 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:39.211232 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1a5a9639-9adf-4f0e-b381-82d05cd0c223 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:39.212136 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1a5a9639-9adf-4f0e-b381-82d05cd0c223 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:39.218498 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1a5a9639-9adf-4f0e-b381-82d05cd0c223 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:39.218942 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1a5a9639-9adf-4f0e-b381-82d05cd0c223 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:39.219722 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1a5a9639-9adf-4f0e-b381-82d05cd0c223 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:39.220151 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1a5a9639-9adf-4f0e-b381-82d05cd0c223 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:39.317080 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1a5a9639-9adf-4f0e-b381-82d05cd0c223 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.109381 Nov 23 14:33:39.323201 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 274/550] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:39 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:39.695726 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9fb14818-7b58-4ec5-a115-ff560e402a89 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:39.696731 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9fb14818-7b58-4ec5-a115-ff560e402a89 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:39.705721 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9fb14818-7b58-4ec5-a115-ff560e402a89 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:39.705984 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9fb14818-7b58-4ec5-a115-ff560e402a89 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:39.707316 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9fb14818-7b58-4ec5-a115-ff560e402a89 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:39.707780 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9fb14818-7b58-4ec5-a115-ff560e402a89 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:39.901912 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9fb14818-7b58-4ec5-a115-ff560e402a89 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:39.909901 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9fb14818-7b58-4ec5-a115-ff560e402a89 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1317 microversion: 2.1 time: 0.218368 Nov 23 14:33:39.910673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 277/551] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:39 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:40.112574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-2a14dae5-a8cf-48f2-9497-820bb47a9666 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:40.113702 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-2a14dae5-a8cf-48f2-9497-820bb47a9666 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:40.122415 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2a14dae5-a8cf-48f2-9497-820bb47a9666 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:40.122981 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2a14dae5-a8cf-48f2-9497-820bb47a9666 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:40.123845 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2a14dae5-a8cf-48f2-9497-820bb47a9666 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:40.124628 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2a14dae5-a8cf-48f2-9497-820bb47a9666 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:40.154514 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8879523c-f306-41ec-ae72-ca1bd3e774c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:40.155433 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8879523c-f306-41ec-ae72-ca1bd3e774c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:40.162083 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8879523c-f306-41ec-ae72-ca1bd3e774c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:40.163022 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-2a14dae5-a8cf-48f2-9497-820bb47a9666 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055432 Nov 23 14:33:40.163200 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8879523c-f306-41ec-ae72-ca1bd3e774c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:40.163925 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 275/552] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:33:40 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:33:40.164574 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8879523c-f306-41ec-ae72-ca1bd3e774c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:40.165170 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8879523c-f306-41ec-ae72-ca1bd3e774c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:40.332883 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-79e4bf52-9f0e-4bba-9cd7-c5ab360dcc0d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:40.333810 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-79e4bf52-9f0e-4bba-9cd7-c5ab360dcc0d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:40.340231 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-79e4bf52-9f0e-4bba-9cd7-c5ab360dcc0d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:40.340691 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-79e4bf52-9f0e-4bba-9cd7-c5ab360dcc0d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:40.341471 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-79e4bf52-9f0e-4bba-9cd7-c5ab360dcc0d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:40.341900 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-79e4bf52-9f0e-4bba-9cd7-c5ab360dcc0d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:46.416661 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8879523c-f306-41ec-ae72-ca1bd3e774c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 6.265748 Nov 23 14:33:46.417618 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-79e4bf52-9f0e-4bba-9cd7-c5ab360dcc0d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 6.087119 Nov 23 14:33:46.418499 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 278/554] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:40 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 6269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:33:46.418635 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 276/554] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:40 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 6090 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:33:46.424110 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ad32debb-94e8-45a8-8287-b337ad3d5067 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:46.424436 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4e826b19-de4f-4325-a9b2-ea30bde452c8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:46.434458 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ad32debb-94e8-45a8-8287-b337ad3d5067 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:46.434768 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4e826b19-de4f-4325-a9b2-ea30bde452c8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:46.434847 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ad32debb-94e8-45a8-8287-b337ad3d5067 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:46.434847 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ad32debb-94e8-45a8-8287-b337ad3d5067 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:46.435701 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ad32debb-94e8-45a8-8287-b337ad3d5067 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:46.435885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4e826b19-de4f-4325-a9b2-ea30bde452c8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:46.436490 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ad32debb-94e8-45a8-8287-b337ad3d5067 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:46.436605 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4e826b19-de4f-4325-a9b2-ea30bde452c8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:46.437374 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4e826b19-de4f-4325-a9b2-ea30bde452c8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:46.437815 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4e826b19-de4f-4325-a9b2-ea30bde452c8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:46.469581 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4e826b19-de4f-4325-a9b2-ea30bde452c8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049288 Nov 23 14:33:46.470282 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 279/555] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:33:46 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:33:46.820742 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ad32debb-94e8-45a8-8287-b337ad3d5067 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:46.829719 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ad32debb-94e8-45a8-8287-b337ad3d5067 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1317 microversion: 2.1 time: 0.408483 Nov 23 14:33:46.829719 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 277/556] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:46 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:47.429707 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6b5df6c3-4d0f-40f7-b9ef-3d85678e1f00 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:47.430422 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-432afb22-8e45-4471-973e-c51ae50d2db7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:47.431230 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6b5df6c3-4d0f-40f7-b9ef-3d85678e1f00 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:47.431435 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-432afb22-8e45-4471-973e-c51ae50d2db7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:47.442507 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-432afb22-8e45-4471-973e-c51ae50d2db7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:47.442967 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-432afb22-8e45-4471-973e-c51ae50d2db7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:47.443770 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-432afb22-8e45-4471-973e-c51ae50d2db7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:47.444208 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-432afb22-8e45-4471-973e-c51ae50d2db7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:47.449813 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6b5df6c3-4d0f-40f7-b9ef-3d85678e1f00 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:47.451321 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6b5df6c3-4d0f-40f7-b9ef-3d85678e1f00 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:47.454029 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6b5df6c3-4d0f-40f7-b9ef-3d85678e1f00 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:47.454555 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6b5df6c3-4d0f-40f7-b9ef-3d85678e1f00 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:47.525003 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-432afb22-8e45-4471-973e-c51ae50d2db7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.095535 Nov 23 14:33:47.525003 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 278/557] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:47 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:47.531327 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-51fe1e9d-3aab-49d2-a07e-60c0cfa9a11e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:47.532588 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-51fe1e9d-3aab-49d2-a07e-60c0cfa9a11e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:47.539846 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-51fe1e9d-3aab-49d2-a07e-60c0cfa9a11e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:47.540310 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-51fe1e9d-3aab-49d2-a07e-60c0cfa9a11e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:47.542071 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-51fe1e9d-3aab-49d2-a07e-60c0cfa9a11e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:47.542942 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-51fe1e9d-3aab-49d2-a07e-60c0cfa9a11e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:47.585030 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-51fe1e9d-3aab-49d2-a07e-60c0cfa9a11e tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057307 Nov 23 14:33:47.585653 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 279/558] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:33:47 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:33:47.784975 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6b5df6c3-4d0f-40f7-b9ef-3d85678e1f00 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.359259 Nov 23 14:33:47.785575 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 280/559] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:47 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:47.846257 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c7983846-ce87-459a-825a-90b35f04edc6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:47.848604 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c7983846-ce87-459a-825a-90b35f04edc6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:47.867608 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c7983846-ce87-459a-825a-90b35f04edc6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:47.869736 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c7983846-ce87-459a-825a-90b35f04edc6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:47.870960 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c7983846-ce87-459a-825a-90b35f04edc6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:47.876329 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c7983846-ce87-459a-825a-90b35f04edc6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:48.069618 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c7983846-ce87-459a-825a-90b35f04edc6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:48.082827 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c7983846-ce87-459a-825a-90b35f04edc6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1317 microversion: 2.1 time: 0.240290 Nov 23 14:33:48.088628 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 280/560] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:47 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:48.536576 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b6fa7e71-a34d-4195-b67c-f2c0b7c69e10 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:48.539322 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b6fa7e71-a34d-4195-b67c-f2c0b7c69e10 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:48.560087 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b6fa7e71-a34d-4195-b67c-f2c0b7c69e10 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:48.564831 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b6fa7e71-a34d-4195-b67c-f2c0b7c69e10 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:48.565939 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b6fa7e71-a34d-4195-b67c-f2c0b7c69e10 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:48.568390 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b6fa7e71-a34d-4195-b67c-f2c0b7c69e10 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:48.677290 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b6fa7e71-a34d-4195-b67c-f2c0b7c69e10 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.144550 Nov 23 14:33:48.678022 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 281/561] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:48 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:33:48.799222 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-8da94f5e-7179-426f-ab90-c3024e9fcc37 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:48.801576 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-8da94f5e-7179-426f-ab90-c3024e9fcc37 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:48.831026 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8da94f5e-7179-426f-ab90-c3024e9fcc37 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:48.831599 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8da94f5e-7179-426f-ab90-c3024e9fcc37 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:48.832543 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8da94f5e-7179-426f-ab90-c3024e9fcc37 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:48.833188 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8da94f5e-7179-426f-ab90-c3024e9fcc37 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:48.967885 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-8da94f5e-7179-426f-ab90-c3024e9fcc37 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.166705 Nov 23 14:33:48.967885 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 281/562] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:48 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:49.105920 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ca7a8b8c-8239-4cf7-869a-8d8347f61b30 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:49.106657 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ca7a8b8c-8239-4cf7-869a-8d8347f61b30 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:49.122204 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ca7a8b8c-8239-4cf7-869a-8d8347f61b30 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:49.122659 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ca7a8b8c-8239-4cf7-869a-8d8347f61b30 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:49.123468 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ca7a8b8c-8239-4cf7-869a-8d8347f61b30 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:49.123907 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ca7a8b8c-8239-4cf7-869a-8d8347f61b30 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:49.543983 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ca7a8b8c-8239-4cf7-869a-8d8347f61b30 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:49.557649 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ca7a8b8c-8239-4cf7-869a-8d8347f61b30 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1317 microversion: 2.1 time: 0.456141 Nov 23 14:33:49.562785 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 282/563] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:49 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:49.691586 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3860face-df2d-42c9-ae6b-e58a1af66df8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:49.693168 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3860face-df2d-42c9-ae6b-e58a1af66df8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:49.708061 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3860face-df2d-42c9-ae6b-e58a1af66df8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:49.709844 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3860face-df2d-42c9-ae6b-e58a1af66df8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:49.714466 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3860face-df2d-42c9-ae6b-e58a1af66df8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:49.715062 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3860face-df2d-42c9-ae6b-e58a1af66df8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:49.975600 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ab9e64bd-e8ed-41e6-9776-dc8ec73532c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:49.976544 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ab9e64bd-e8ed-41e6-9776-dc8ec73532c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:49.986199 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ab9e64bd-e8ed-41e6-9776-dc8ec73532c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:49.986651 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ab9e64bd-e8ed-41e6-9776-dc8ec73532c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:49.988819 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ab9e64bd-e8ed-41e6-9776-dc8ec73532c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:49.989254 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ab9e64bd-e8ed-41e6-9776-dc8ec73532c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:52.097561 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:33:52.098205 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: Tue Nov 23 14:33:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action (ip 10.222.0.82) !!! Nov 23 14:33:52.343405 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:33:52.343948 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: Tue Nov 23 14:33:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action (ip 10.222.0.82) !!! Nov 23 14:33:53.526975 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3860face-df2d-42c9-ae6b-e58a1af66df8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 3.840271 Nov 23 14:33:53.528745 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 282/564] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:49 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 3842 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:53.532808 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a530d254-65ab-4dc3-9564-ecb81174f8a7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:53.533497 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a530d254-65ab-4dc3-9564-ecb81174f8a7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:53.540546 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a530d254-65ab-4dc3-9564-ecb81174f8a7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:53.540997 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a530d254-65ab-4dc3-9564-ecb81174f8a7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:53.541943 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a530d254-65ab-4dc3-9564-ecb81174f8a7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:53.542369 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a530d254-65ab-4dc3-9564-ecb81174f8a7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:53.560759 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ab9e64bd-e8ed-41e6-9776-dc8ec73532c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 3.589127 Nov 23 14:33:53.561742 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 283/565] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:49 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 3591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:53.726958 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a530d254-65ab-4dc3-9564-ecb81174f8a7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:53.734900 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a530d254-65ab-4dc3-9564-ecb81174f8a7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1317 microversion: 2.1 time: 0.205791 Nov 23 14:33:53.735682 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 283/566] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:53 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:53.746164 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-eda8eece-9b06-4949-b489-f2e3eb7e8757 req-ae5ac0df-01a7-426d-9554-d9f3e3269fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c214697-d673-4304-b403-6624296f8ef2", "name": "network-vif-plugged", "status": "completed", "tag": "33c40c31-9d6e-4241-9de7-e23035380d49"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:53.746164 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:33:53.746164 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:33:53.758859 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-eda8eece-9b06-4949-b489-f2e3eb7e8757 req-ae5ac0df-01a7-426d-9554-d9f3e3269fca service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:53.759637 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-eda8eece-9b06-4949-b489-f2e3eb7e8757 req-ae5ac0df-01a7-426d-9554-d9f3e3269fca service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:53.772810 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-eda8eece-9b06-4949-b489-f2e3eb7e8757 req-ae5ac0df-01a7-426d-9554-d9f3e3269fca service nova] Creating event network-vif-plugged:33c40c31-9d6e-4241-9de7-e23035380d49 for instance 1c214697-d673-4304-b403-6624296f8ef2 on hv-cinder-80475 Nov 23 14:33:53.778378 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-eda8eece-9b06-4949-b489-f2e3eb7e8757 req-ae5ac0df-01a7-426d-9554-d9f3e3269fca service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041179 Nov 23 14:33:53.779222 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 284/567] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:33:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:33:53.859994 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e9321938-4428-4613-aa3d-e83e4c28e3c0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Action: 'create', calling method: .version_select at 0x7f2088162670>, body: {"keypair": {"name": "tempest-TestShelveInstance-2032644991"}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:53.883555 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-e9321938-4428-4613-aa3d-e83e4c28e3c0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Getting quotas for project c62f306655ec464f9295fc94d9ce4e1a. Resources: {'key_pairs'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:33:53.888531 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-e9321938-4428-4613-aa3d-e83e4c28e3c0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Getting quotas for user 080e264b5b294d37b944f74ec75fb5bc and project c62f306655ec464f9295fc94d9ce4e1a. Resources: {'key_pairs'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:33:54.102094 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-e9321938-4428-4613-aa3d-e83e4c28e3c0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Getting quotas for project c62f306655ec464f9295fc94d9ce4e1a. Resources: {'key_pairs'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:33:54.110803 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-e9321938-4428-4613-aa3d-e83e4c28e3c0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Getting quotas for user 080e264b5b294d37b944f74ec75fb5bc and project c62f306655ec464f9295fc94d9ce4e1a. Resources: {'key_pairs'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:33:54.128577 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e9321938-4428-4613-aa3d-e83e4c28e3c0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.565772 Nov 23 14:33:54.129365 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 284/568] 10.222.0.82 () {60 vars in 1157 bytes} [Tue Nov 23 14:33:53 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:54.538793 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-52db66f8-4bd0-46b1-ad31-4ed25b8160f5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:54.539873 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-52db66f8-4bd0-46b1-ad31-4ed25b8160f5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:54.547495 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-52db66f8-4bd0-46b1-ad31-4ed25b8160f5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:54.548095 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-52db66f8-4bd0-46b1-ad31-4ed25b8160f5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:54.548956 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-52db66f8-4bd0-46b1-ad31-4ed25b8160f5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:54.549462 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-52db66f8-4bd0-46b1-ad31-4ed25b8160f5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:54.573176 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c12df8a2-4cc1-4fe3-a942-cc8fb1730b0e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:54.574341 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c12df8a2-4cc1-4fe3-a942-cc8fb1730b0e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:54.585466 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c12df8a2-4cc1-4fe3-a942-cc8fb1730b0e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:54.585924 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c12df8a2-4cc1-4fe3-a942-cc8fb1730b0e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:54.586719 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c12df8a2-4cc1-4fe3-a942-cc8fb1730b0e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:54.587377 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c12df8a2-4cc1-4fe3-a942-cc8fb1730b0e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:54.747301 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-52db66f8-4bd0-46b1-ad31-4ed25b8160f5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.212680 Nov 23 14:33:54.747999 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 285/569] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:54 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:33:54.761740 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3fc90d24-b61a-483f-8362-bb67bbf9845f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:54.762567 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3fc90d24-b61a-483f-8362-bb67bbf9845f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:54.769881 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3fc90d24-b61a-483f-8362-bb67bbf9845f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:54.770325 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3fc90d24-b61a-483f-8362-bb67bbf9845f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:54.771247 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3fc90d24-b61a-483f-8362-bb67bbf9845f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:54.771679 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3fc90d24-b61a-483f-8362-bb67bbf9845f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:54.796152 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c12df8a2-4cc1-4fe3-a942-cc8fb1730b0e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.227533 Nov 23 14:33:54.796954 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 285/570] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:54 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:33:54.924081 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-3fc90d24-b61a-483f-8362-bb67bbf9845f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:54.931463 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3fc90d24-b61a-483f-8362-bb67bbf9845f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1317 microversion: 2.1 time: 0.174666 Nov 23 14:33:54.932708 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 286/571] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:54 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:55.584004 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3deef78c-6d4e-41c9-ae51-feb4ec699d7f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:55.584770 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3deef78c-6d4e-41c9-ae51-feb4ec699d7f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:55.592276 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3deef78c-6d4e-41c9-ae51-feb4ec699d7f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:55.592826 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3deef78c-6d4e-41c9-ae51-feb4ec699d7f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:55.593690 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3deef78c-6d4e-41c9-ae51-feb4ec699d7f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:55.594209 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3deef78c-6d4e-41c9-ae51-feb4ec699d7f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:55.622425 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3deef78c-6d4e-41c9-ae51-feb4ec699d7f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Going to try to terminate instance {{(pid=116787) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:33:55.761105 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-fb800c0d-e5da-4045-8f9c-b5ff61741943 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:55.762814 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-fb800c0d-e5da-4045-8f9c-b5ff61741943 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:55.771574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fb800c0d-e5da-4045-8f9c-b5ff61741943 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:55.772304 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fb800c0d-e5da-4045-8f9c-b5ff61741943 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:55.773400 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fb800c0d-e5da-4045-8f9c-b5ff61741943 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:55.774020 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fb800c0d-e5da-4045-8f9c-b5ff61741943 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:55.936769 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3deef78c-6d4e-41c9-ae51-feb4ec699d7f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "DELETE /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 204 len: 0 microversion: 2.1 time: 0.356529 Nov 23 14:33:55.946284 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 286/572] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:33:55 2021] DELETE /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 14:33:55.952519 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3cfb7fd3-47f2-4ad4-90fa-13801bc407ca tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:55.953511 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3cfb7fd3-47f2-4ad4-90fa-13801bc407ca tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:55.960180 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3cfb7fd3-47f2-4ad4-90fa-13801bc407ca tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:55.960872 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3cfb7fd3-47f2-4ad4-90fa-13801bc407ca tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:55.961678 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3cfb7fd3-47f2-4ad4-90fa-13801bc407ca tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:55.962117 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3cfb7fd3-47f2-4ad4-90fa-13801bc407ca tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:55.979864 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-fb800c0d-e5da-4045-8f9c-b5ff61741943 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.224406 Nov 23 14:33:55.980851 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 287/573] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:55 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:33:55.985926 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c59c6455-8f40-48e1-b20d-f6fd940692e0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:55.989085 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c59c6455-8f40-48e1-b20d-f6fd940692e0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:55.998450 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c59c6455-8f40-48e1-b20d-f6fd940692e0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:55.998902 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c59c6455-8f40-48e1-b20d-f6fd940692e0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:56.000676 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c59c6455-8f40-48e1-b20d-f6fd940692e0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:56.000676 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c59c6455-8f40-48e1-b20d-f6fd940692e0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:56.037087 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3cfb7fd3-47f2-4ad4-90fa-13801bc407ca tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.088967 Nov 23 14:33:56.042491 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 287/574] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:55 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:33:56.043469 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-69a7e367-9fb1-44bd-a18a-c41d5c0ec5f8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:33:56.044156 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-69a7e367-9fb1-44bd-a18a-c41d5c0ec5f8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:56.051235 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-69a7e367-9fb1-44bd-a18a-c41d5c0ec5f8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:56.051690 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-69a7e367-9fb1-44bd-a18a-c41d5c0ec5f8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:56.052500 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-69a7e367-9fb1-44bd-a18a-c41d5c0ec5f8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:56.052939 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-69a7e367-9fb1-44bd-a18a-c41d5c0ec5f8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:56.193604 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c59c6455-8f40-48e1-b20d-f6fd940692e0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:56.203907 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c59c6455-8f40-48e1-b20d-f6fd940692e0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1317 microversion: 2.1 time: 0.221509 Nov 23 14:33:56.204874 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 288/575] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:55 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:56.306861 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-69a7e367-9fb1-44bd-a18a-c41d5c0ec5f8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:33:56.315550 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-69a7e367-9fb1-44bd-a18a-c41d5c0ec5f8 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1506 microversion: 2.1 time: 0.276397 Nov 23 14:33:56.316118 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 288/576] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:33:56 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:33:56.997818 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-2ef75c31-000a-476e-89d3-737b34b7fa1f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:56.997818 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-2ef75c31-000a-476e-89d3-737b34b7fa1f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:57.003742 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2ef75c31-000a-476e-89d3-737b34b7fa1f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:57.004606 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2ef75c31-000a-476e-89d3-737b34b7fa1f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:57.005763 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2ef75c31-000a-476e-89d3-737b34b7fa1f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:57.006799 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2ef75c31-000a-476e-89d3-737b34b7fa1f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:57.051065 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-414e5b14-3389-4250-b578-fc6ee2802e83 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:33:57.052050 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-414e5b14-3389-4250-b578-fc6ee2802e83 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:33:57.061025 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-414e5b14-3389-4250-b578-fc6ee2802e83 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:57.063742 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-414e5b14-3389-4250-b578-fc6ee2802e83 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:33:57.064739 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-414e5b14-3389-4250-b578-fc6ee2802e83 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:33:57.065373 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-414e5b14-3389-4250-b578-fc6ee2802e83 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:01.835461 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-2ef75c31-000a-476e-89d3-737b34b7fa1f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 4.846949 Nov 23 14:34:01.840082 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 289/577] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:33:56 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 4849 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:01.840422 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-414e5b14-3389-4250-b578-fc6ee2802e83 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 4.792770 Nov 23 14:34:01.844889 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 289/578] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:33:57 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 4795 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:01.845000 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6234cfc4-7c62-4f81-9512-626ace8c242b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:01.845000 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6234cfc4-7c62-4f81-9512-626ace8c242b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:01.847920 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c6954780-b2aa-4ad4-a126-7d743b1a731c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:01.848907 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c6954780-b2aa-4ad4-a126-7d743b1a731c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:01.849834 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6234cfc4-7c62-4f81-9512-626ace8c242b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:01.850606 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6234cfc4-7c62-4f81-9512-626ace8c242b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:01.851417 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6234cfc4-7c62-4f81-9512-626ace8c242b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:01.851848 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6234cfc4-7c62-4f81-9512-626ace8c242b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:01.860636 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c6954780-b2aa-4ad4-a126-7d743b1a731c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:01.861086 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c6954780-b2aa-4ad4-a126-7d743b1a731c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:01.862175 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c6954780-b2aa-4ad4-a126-7d743b1a731c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:01.862609 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c6954780-b2aa-4ad4-a126-7d743b1a731c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:01.996993 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6234cfc4-7c62-4f81-9512-626ace8c242b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:02.004374 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6234cfc4-7c62-4f81-9512-626ace8c242b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1506 microversion: 2.1 time: 0.166716 Nov 23 14:34:02.004591 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c6954780-b2aa-4ad4-a126-7d743b1a731c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:02.004981 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 290/579] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:01 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:02.012387 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c6954780-b2aa-4ad4-a126-7d743b1a731c tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1506 microversion: 2.1 time: 0.170282 Nov 23 14:34:02.013095 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 290/580] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:01 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:02.847288 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-fd121e84-ed11-4ada-ba7e-3fd5b6913f95 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:02.848200 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-fd121e84-ed11-4ada-ba7e-3fd5b6913f95 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:02.852201 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8a64f864-6c86-4814-93a8-187df0d7abd7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:02.853134 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8a64f864-6c86-4814-93a8-187df0d7abd7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:02.854626 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fd121e84-ed11-4ada-ba7e-3fd5b6913f95 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:02.854997 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fd121e84-ed11-4ada-ba7e-3fd5b6913f95 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:02.856341 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fd121e84-ed11-4ada-ba7e-3fd5b6913f95 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:02.856779 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fd121e84-ed11-4ada-ba7e-3fd5b6913f95 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:02.860373 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8a64f864-6c86-4814-93a8-187df0d7abd7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:02.860764 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8a64f864-6c86-4814-93a8-187df0d7abd7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:02.861563 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8a64f864-6c86-4814-93a8-187df0d7abd7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:02.861996 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8a64f864-6c86-4814-93a8-187df0d7abd7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:02.957985 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-fd121e84-ed11-4ada-ba7e-3fd5b6913f95 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.114507 Nov 23 14:34:02.958914 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 291/581] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:02 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:02.966970 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8a64f864-6c86-4814-93a8-187df0d7abd7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.118440 Nov 23 14:34:02.967834 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 291/582] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:02 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:03.029613 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-886de2a9-1488-4ab2-b716-ce377ec2ce1a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:03.030311 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-886de2a9-1488-4ab2-b716-ce377ec2ce1a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:03.037216 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-886de2a9-1488-4ab2-b716-ce377ec2ce1a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:03.037665 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-886de2a9-1488-4ab2-b716-ce377ec2ce1a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:03.038442 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-886de2a9-1488-4ab2-b716-ce377ec2ce1a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:03.039172 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-886de2a9-1488-4ab2-b716-ce377ec2ce1a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:03.173206 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-886de2a9-1488-4ab2-b716-ce377ec2ce1a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:03.180519 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-886de2a9-1488-4ab2-b716-ce377ec2ce1a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1506 microversion: 2.1 time: 0.155303 Nov 23 14:34:03.181080 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 292/583] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:03 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:03.972206 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ce975087-a573-4a19-bf28-10513239ecec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:03.974725 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ce975087-a573-4a19-bf28-10513239ecec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:03.978446 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5b20493b-10f7-4ee5-8033-aeec93564fe9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:03.979362 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5b20493b-10f7-4ee5-8033-aeec93564fe9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:03.983574 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ce975087-a573-4a19-bf28-10513239ecec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:03.984411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ce975087-a573-4a19-bf28-10513239ecec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:03.985387 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ce975087-a573-4a19-bf28-10513239ecec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:03.985985 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ce975087-a573-4a19-bf28-10513239ecec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:03.986392 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5b20493b-10f7-4ee5-8033-aeec93564fe9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:03.986910 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5b20493b-10f7-4ee5-8033-aeec93564fe9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:03.987797 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5b20493b-10f7-4ee5-8033-aeec93564fe9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:03.988412 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5b20493b-10f7-4ee5-8033-aeec93564fe9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:04.101865 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5b20493b-10f7-4ee5-8033-aeec93564fe9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.126788 Nov 23 14:34:04.102506 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 293/584] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:03 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:04.128802 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ce975087-a573-4a19-bf28-10513239ecec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.161437 Nov 23 14:34:04.129689 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 292/585] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:03 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:04.197656 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9bdb66a6-95db-4bf0-bd92-173cf57e481d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:04.198452 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9bdb66a6-95db-4bf0-bd92-173cf57e481d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:04.205522 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9bdb66a6-95db-4bf0-bd92-173cf57e481d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:04.205984 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9bdb66a6-95db-4bf0-bd92-173cf57e481d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:04.206771 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9bdb66a6-95db-4bf0-bd92-173cf57e481d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:04.207207 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9bdb66a6-95db-4bf0-bd92-173cf57e481d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:04.342447 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9bdb66a6-95db-4bf0-bd92-173cf57e481d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:04.350087 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9bdb66a6-95db-4bf0-bd92-173cf57e481d tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1506 microversion: 2.1 time: 0.156356 Nov 23 14:34:04.353507 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 294/586] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:04 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:04.415453 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0ddbd42d-c664-4b35-abb5-82d8e7190ac3 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e600387-d573-4461-b700-5411d326c501", "device": "/dev/sdb"}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:04.417136 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0ddbd42d-c664-4b35-abb5-82d8e7190ac3 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:04.424365 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0ddbd42d-c664-4b35-abb5-82d8e7190ac3 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:04.424817 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0ddbd42d-c664-4b35-abb5-82d8e7190ac3 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:04.425589 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0ddbd42d-c664-4b35-abb5-82d8e7190ac3 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:04.426025 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0ddbd42d-c664-4b35-abb5-82d8e7190ac3 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:04.690319 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-4f41233d-206d-459a-b2e5-d55592a575a3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b044062e-2dd3-45cb-8546-bba1597f762d"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:04.691362 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-4f41233d-206d-459a-b2e5-d55592a575a3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:04.697812 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4f41233d-206d-459a-b2e5-d55592a575a3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:04.698264 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4f41233d-206d-459a-b2e5-d55592a575a3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:04.699044 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4f41233d-206d-459a-b2e5-d55592a575a3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:04.699471 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4f41233d-206d-459a-b2e5-d55592a575a3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:05.191135 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0ddbd42d-c664-4b35-abb5-82d8e7190ac3 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "POST /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.779838 Nov 23 14:34:05.193325 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 293/587] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Nov 23 14:34:04 2021] POST /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1/os-volume_attachments => generated 194 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:34:05.198832 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a3135862-de94-4bce-8d47-d8a948ea58fd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:05.200125 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a3135862-de94-4bce-8d47-d8a948ea58fd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:05.215507 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a3135862-de94-4bce-8d47-d8a948ea58fd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:05.218726 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a3135862-de94-4bce-8d47-d8a948ea58fd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:05.218726 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a3135862-de94-4bce-8d47-d8a948ea58fd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:05.218726 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a3135862-de94-4bce-8d47-d8a948ea58fd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:05.304193 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a3135862-de94-4bce-8d47-d8a948ea58fd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.109382 Nov 23 14:34:05.305354 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 294/588] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:05 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:05.316773 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8d80e224-f57e-4c27-b278-c6f2c0109c7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:05.316773 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8d80e224-f57e-4c27-b278-c6f2c0109c7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:05.318836 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8d80e224-f57e-4c27-b278-c6f2c0109c7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:05.319350 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8d80e224-f57e-4c27-b278-c6f2c0109c7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:05.320219 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8d80e224-f57e-4c27-b278-c6f2c0109c7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:05.321242 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8d80e224-f57e-4c27-b278-c6f2c0109c7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:05.438229 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8d80e224-f57e-4c27-b278-c6f2c0109c7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.131174 Nov 23 14:34:05.438990 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 295/589] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:05 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:05.445396 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-49bf429c-1087-466f-9604-08623e40abb0 req-82b56ce2-4adc-450a-95a9-89b9f26d43c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3240fe59-76d8-41ec-b0b5-42e56aa99597", "name": "network-vif-deleted", "tag": "a1493c8d-1347-413a-a2df-021ced559963"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:05.447005 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:34:05.447005 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:34:05.455565 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-49bf429c-1087-466f-9604-08623e40abb0 req-82b56ce2-4adc-450a-95a9-89b9f26d43c0 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:05.456006 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-49bf429c-1087-466f-9604-08623e40abb0 req-82b56ce2-4adc-450a-95a9-89b9f26d43c0 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:05.467508 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-49bf429c-1087-466f-9604-08623e40abb0 req-82b56ce2-4adc-450a-95a9-89b9f26d43c0 service nova] Creating event network-vif-deleted:a1493c8d-1347-413a-a2df-021ced559963 for instance 3240fe59-76d8-41ec-b0b5-42e56aa99597 on hv-cinder-80475 Nov 23 14:34:05.472102 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-49bf429c-1087-466f-9604-08623e40abb0 req-82b56ce2-4adc-450a-95a9-89b9f26d43c0 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030502 Nov 23 14:34:05.472838 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 296/590] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:34:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:34:05.477711 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-87d72bb6-965f-4d72-8951-af129f78e320 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:05.478467 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-87d72bb6-965f-4d72-8951-af129f78e320 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:05.484930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-87d72bb6-965f-4d72-8951-af129f78e320 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:05.485387 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-87d72bb6-965f-4d72-8951-af129f78e320 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:05.486157 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-87d72bb6-965f-4d72-8951-af129f78e320 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:05.486620 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-87d72bb6-965f-4d72-8951-af129f78e320 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:05.558402 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-87d72bb6-965f-4d72-8951-af129f78e320 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:05.566040 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-87d72bb6-965f-4d72-8951-af129f78e320 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 200 len: 1292 microversion: 2.1 time: 0.092102 Nov 23 14:34:05.566605 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 297/591] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:05 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:05.589488 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-4f41233d-206d-459a-b2e5-d55592a575a3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "POST /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.902805 Nov 23 14:34:05.590712 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 295/592] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Nov 23 14:34:04 2021] POST /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2/os-volume_attachments => generated 194 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:34:06.319583 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f5e167e7-b825-4b36-b219-c2ecefa4b9cd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:06.320633 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f5e167e7-b825-4b36-b219-c2ecefa4b9cd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:06.327121 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f5e167e7-b825-4b36-b219-c2ecefa4b9cd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:06.332018 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f5e167e7-b825-4b36-b219-c2ecefa4b9cd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:06.332018 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f5e167e7-b825-4b36-b219-c2ecefa4b9cd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:06.332018 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f5e167e7-b825-4b36-b219-c2ecefa4b9cd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:06.419668 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f5e167e7-b825-4b36-b219-c2ecefa4b9cd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.106747 Nov 23 14:34:06.420563 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 298/593] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:06 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:06.451713 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b9a6ea15-14b1-46ac-b76a-248597590476 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:06.452898 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b9a6ea15-14b1-46ac-b76a-248597590476 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:06.459752 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b9a6ea15-14b1-46ac-b76a-248597590476 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:06.460201 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b9a6ea15-14b1-46ac-b76a-248597590476 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:06.461009 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b9a6ea15-14b1-46ac-b76a-248597590476 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:06.461477 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b9a6ea15-14b1-46ac-b76a-248597590476 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:06.575430 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b9a6ea15-14b1-46ac-b76a-248597590476 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.128085 Nov 23 14:34:06.576096 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 296/594] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:06 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:06.583613 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-68186230-3293-4db8-ab19-b3b7f514aed6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:06.584342 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-68186230-3293-4db8-ab19-b3b7f514aed6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 3240fe59-76d8-41ec-b0b5-42e56aa99597] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:06.591251 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-68186230-3293-4db8-ab19-b3b7f514aed6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:06.591692 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-68186230-3293-4db8-ab19-b3b7f514aed6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:06.592489 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-68186230-3293-4db8-ab19-b3b7f514aed6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:06.592926 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-68186230-3293-4db8-ab19-b3b7f514aed6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:06.607408 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-68186230-3293-4db8-ab19-b3b7f514aed6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] HTTP exception thrown: Instance 3240fe59-76d8-41ec-b0b5-42e56aa99597 could not be found. Nov 23 14:34:06.608142 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-68186230-3293-4db8-ab19-b3b7f514aed6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Returning 404 to user: Instance 3240fe59-76d8-41ec-b0b5-42e56aa99597 could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:34:06.608970 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-68186230-3293-4db8-ab19-b3b7f514aed6 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597" status: 404 len: 111 microversion: 2.1 time: 0.029389 Nov 23 14:34:06.609771 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 299/595] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:06 2021] GET /compute/v2.1/servers/3240fe59-76d8-41ec-b0b5-42e56aa99597 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:34:06.618495 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-dfbd8952-f110-4ef2-94c8-9ae77e378ecb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:06.619079 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-dfbd8952-f110-4ef2-94c8-9ae77e378ecb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:06.625927 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dfbd8952-f110-4ef2-94c8-9ae77e378ecb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:06.626367 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dfbd8952-f110-4ef2-94c8-9ae77e378ecb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:06.627123 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dfbd8952-f110-4ef2-94c8-9ae77e378ecb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:06.627549 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dfbd8952-f110-4ef2-94c8-9ae77e378ecb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:06.652677 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-dfbd8952-f110-4ef2-94c8-9ae77e378ecb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Going to try to terminate instance {{(pid=116788) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:34:06.931769 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-dfbd8952-f110-4ef2-94c8-9ae77e378ecb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "DELETE /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 204 len: 0 microversion: 2.1 time: 0.316702 Nov 23 14:34:06.932314 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 297/596] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:34:06 2021] DELETE /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 14:34:06.940776 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d1763b33-3091-4f2e-8674-451224cfe37b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:06.941377 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d1763b33-3091-4f2e-8674-451224cfe37b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:06.947443 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d1763b33-3091-4f2e-8674-451224cfe37b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:06.947930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d1763b33-3091-4f2e-8674-451224cfe37b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:06.948713 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d1763b33-3091-4f2e-8674-451224cfe37b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:06.949144 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d1763b33-3091-4f2e-8674-451224cfe37b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:07.086591 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d1763b33-3091-4f2e-8674-451224cfe37b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:07.093867 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d1763b33-3091-4f2e-8674-451224cfe37b tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.157493 Nov 23 14:34:07.094420 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 300/597] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:06 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:07.432289 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d803e6f2-d042-48f7-99ac-8d21c78f406b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:07.433285 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d803e6f2-d042-48f7-99ac-8d21c78f406b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:07.441143 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d803e6f2-d042-48f7-99ac-8d21c78f406b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:07.441591 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d803e6f2-d042-48f7-99ac-8d21c78f406b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:07.442375 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d803e6f2-d042-48f7-99ac-8d21c78f406b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:07.442808 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d803e6f2-d042-48f7-99ac-8d21c78f406b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:07.507067 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d803e6f2-d042-48f7-99ac-8d21c78f406b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.078737 Nov 23 14:34:07.507726 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 298/598] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:07 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:07.586762 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-529240f0-daf8-459c-9b43-adeb6190813f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:07.588783 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-529240f0-daf8-459c-9b43-adeb6190813f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:07.594923 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-529240f0-daf8-459c-9b43-adeb6190813f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:07.595372 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-529240f0-daf8-459c-9b43-adeb6190813f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:07.596152 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-529240f0-daf8-459c-9b43-adeb6190813f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:07.596722 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-529240f0-daf8-459c-9b43-adeb6190813f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:07.673048 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-529240f0-daf8-459c-9b43-adeb6190813f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.089045 Nov 23 14:34:07.673735 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 301/599] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:07 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:08.112165 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-97626104-0b3e-4bbb-b3d4-60e85e223d1f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:08.112780 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-97626104-0b3e-4bbb-b3d4-60e85e223d1f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:08.120060 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-97626104-0b3e-4bbb-b3d4-60e85e223d1f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:08.120573 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-97626104-0b3e-4bbb-b3d4-60e85e223d1f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:08.121427 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-97626104-0b3e-4bbb-b3d4-60e85e223d1f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:08.121867 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-97626104-0b3e-4bbb-b3d4-60e85e223d1f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:08.272159 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-97626104-0b3e-4bbb-b3d4-60e85e223d1f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:08.279479 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-97626104-0b3e-4bbb-b3d4-60e85e223d1f tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.171615 Nov 23 14:34:08.280040 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 299/600] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:08 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:08.521037 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0919d88f-9966-4c4e-b4c7-a1d599071c13 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:08.522039 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0919d88f-9966-4c4e-b4c7-a1d599071c13 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:08.528894 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0919d88f-9966-4c4e-b4c7-a1d599071c13 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:08.529350 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0919d88f-9966-4c4e-b4c7-a1d599071c13 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:08.530130 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0919d88f-9966-4c4e-b4c7-a1d599071c13 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:08.530561 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0919d88f-9966-4c4e-b4c7-a1d599071c13 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:08.596688 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0919d88f-9966-4c4e-b4c7-a1d599071c13 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.081045 Nov 23 14:34:08.597301 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 302/601] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:08 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:08.684837 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e9f6cb89-c342-4311-94ec-13ec0a39657a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:08.685686 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e9f6cb89-c342-4311-94ec-13ec0a39657a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:08.693246 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e9f6cb89-c342-4311-94ec-13ec0a39657a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:08.693691 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e9f6cb89-c342-4311-94ec-13ec0a39657a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:08.694462 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e9f6cb89-c342-4311-94ec-13ec0a39657a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:08.694898 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e9f6cb89-c342-4311-94ec-13ec0a39657a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:08.759574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e9f6cb89-c342-4311-94ec-13ec0a39657a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.078369 Nov 23 14:34:08.760199 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 300/602] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:08 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:09.297702 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-851b8544-9ef2-41db-be1c-02a24b15dcc9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:09.299130 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-851b8544-9ef2-41db-be1c-02a24b15dcc9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:09.305906 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-851b8544-9ef2-41db-be1c-02a24b15dcc9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:09.306355 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-851b8544-9ef2-41db-be1c-02a24b15dcc9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:09.307127 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-851b8544-9ef2-41db-be1c-02a24b15dcc9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:09.307558 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-851b8544-9ef2-41db-be1c-02a24b15dcc9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:09.447340 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-851b8544-9ef2-41db-be1c-02a24b15dcc9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:09.454540 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-851b8544-9ef2-41db-be1c-02a24b15dcc9 tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.160822 Nov 23 14:34:09.455622 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 303/603] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:09 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:09.608831 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-21e69cba-69da-4cef-afea-5324f2b15589 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:09.610056 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-21e69cba-69da-4cef-afea-5324f2b15589 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:09.619063 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-21e69cba-69da-4cef-afea-5324f2b15589 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:09.619513 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-21e69cba-69da-4cef-afea-5324f2b15589 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:09.620315 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-21e69cba-69da-4cef-afea-5324f2b15589 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:09.620768 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-21e69cba-69da-4cef-afea-5324f2b15589 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:09.688486 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-21e69cba-69da-4cef-afea-5324f2b15589 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.083355 Nov 23 14:34:09.689745 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 301/604] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:09 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:09.771640 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b719dd3b-3cb6-46ac-8aa9-ffc08397739d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:09.772781 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b719dd3b-3cb6-46ac-8aa9-ffc08397739d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:09.781196 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b719dd3b-3cb6-46ac-8aa9-ffc08397739d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:09.781644 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b719dd3b-3cb6-46ac-8aa9-ffc08397739d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:09.782418 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b719dd3b-3cb6-46ac-8aa9-ffc08397739d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:09.782853 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b719dd3b-3cb6-46ac-8aa9-ffc08397739d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:09.853843 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b719dd3b-3cb6-46ac-8aa9-ffc08397739d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.086302 Nov 23 14:34:09.854496 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 304/605] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:09 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:10.472656 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c50ff038-e262-4bcd-9b3a-a29b1c9eef0a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:10.473268 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c50ff038-e262-4bcd-9b3a-a29b1c9eef0a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:10.480064 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c50ff038-e262-4bcd-9b3a-a29b1c9eef0a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:10.480540 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c50ff038-e262-4bcd-9b3a-a29b1c9eef0a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:10.481305 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c50ff038-e262-4bcd-9b3a-a29b1c9eef0a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:10.481738 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c50ff038-e262-4bcd-9b3a-a29b1c9eef0a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:10.620394 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c50ff038-e262-4bcd-9b3a-a29b1c9eef0a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:10.628996 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c50ff038-e262-4bcd-9b3a-a29b1c9eef0a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.159966 Nov 23 14:34:10.629571 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 302/606] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:10 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:10.701115 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7bfe8d65-b609-40ec-9670-64c64567d121 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:10.702098 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7bfe8d65-b609-40ec-9670-64c64567d121 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:10.708979 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7bfe8d65-b609-40ec-9670-64c64567d121 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:10.709425 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7bfe8d65-b609-40ec-9670-64c64567d121 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:10.710191 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7bfe8d65-b609-40ec-9670-64c64567d121 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:10.710625 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7bfe8d65-b609-40ec-9670-64c64567d121 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:10.781545 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7bfe8d65-b609-40ec-9670-64c64567d121 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.084136 Nov 23 14:34:10.782186 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 305/607] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:10 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:10.866202 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-82d0b479-c095-4ea9-8e8d-c24a85c400d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:10.867104 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-82d0b479-c095-4ea9-8e8d-c24a85c400d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:10.873373 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-82d0b479-c095-4ea9-8e8d-c24a85c400d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:10.873820 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-82d0b479-c095-4ea9-8e8d-c24a85c400d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:10.874592 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-82d0b479-c095-4ea9-8e8d-c24a85c400d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:10.875027 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-82d0b479-c095-4ea9-8e8d-c24a85c400d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:10.952013 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-82d0b479-c095-4ea9-8e8d-c24a85c400d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.089363 Nov 23 14:34:10.952707 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 303/608] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:10 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:11.647753 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-76763c11-e987-46f7-87a0-cc5ac05f80fc tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:11.648510 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-76763c11-e987-46f7-87a0-cc5ac05f80fc tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:11.655313 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-76763c11-e987-46f7-87a0-cc5ac05f80fc tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:11.655756 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-76763c11-e987-46f7-87a0-cc5ac05f80fc tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:11.656560 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-76763c11-e987-46f7-87a0-cc5ac05f80fc tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:11.656987 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-76763c11-e987-46f7-87a0-cc5ac05f80fc tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:11.785298 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-76763c11-e987-46f7-87a0-cc5ac05f80fc tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:11.793601 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-76763c11-e987-46f7-87a0-cc5ac05f80fc tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.151028 Nov 23 14:34:11.794145 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 306/609] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:11 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:11.794712 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b8ffa928-2b23-4c2b-b69c-ac066d03efb2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:11.795742 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b8ffa928-2b23-4c2b-b69c-ac066d03efb2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:11.803358 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b8ffa928-2b23-4c2b-b69c-ac066d03efb2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:11.803801 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b8ffa928-2b23-4c2b-b69c-ac066d03efb2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:11.804797 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b8ffa928-2b23-4c2b-b69c-ac066d03efb2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:11.805226 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b8ffa928-2b23-4c2b-b69c-ac066d03efb2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:11.950024 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b8ffa928-2b23-4c2b-b69c-ac066d03efb2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.159185 Nov 23 14:34:11.950939 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 304/610] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:11 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:11.964482 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-957a1d0e-dbd7-418c-9d93-5721a85d2f7c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:11.965521 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-957a1d0e-dbd7-418c-9d93-5721a85d2f7c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:11.971982 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-957a1d0e-dbd7-418c-9d93-5721a85d2f7c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:11.972456 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-957a1d0e-dbd7-418c-9d93-5721a85d2f7c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:11.973303 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-957a1d0e-dbd7-418c-9d93-5721a85d2f7c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:11.973805 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-957a1d0e-dbd7-418c-9d93-5721a85d2f7c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:12.043319 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-957a1d0e-dbd7-418c-9d93-5721a85d2f7c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.082874 Nov 23 14:34:12.044181 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 307/611] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:11 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:12.815711 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-fe1eb1be-cf87-488a-aca0-2091fa000ffb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:12.815711 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-fe1eb1be-cf87-488a-aca0-2091fa000ffb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:12.821621 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fe1eb1be-cf87-488a-aca0-2091fa000ffb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:12.822075 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fe1eb1be-cf87-488a-aca0-2091fa000ffb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:12.822913 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fe1eb1be-cf87-488a-aca0-2091fa000ffb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:12.823352 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fe1eb1be-cf87-488a-aca0-2091fa000ffb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:12.964057 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6f8d154b-c97e-42c7-8a33-74fbb27cb330 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:12.965742 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6f8d154b-c97e-42c7-8a33-74fbb27cb330 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:12.972899 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-fe1eb1be-cf87-488a-aca0-2091fa000ffb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:12.973184 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6f8d154b-c97e-42c7-8a33-74fbb27cb330 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:12.973631 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6f8d154b-c97e-42c7-8a33-74fbb27cb330 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:12.974472 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6f8d154b-c97e-42c7-8a33-74fbb27cb330 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:12.974899 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6f8d154b-c97e-42c7-8a33-74fbb27cb330 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:12.980909 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-fe1eb1be-cf87-488a-aca0-2091fa000ffb tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1520 microversion: 2.1 time: 0.172527 Nov 23 14:34:12.981483 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 305/612] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:12 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:13.054621 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b95b7687-dbfb-427c-973f-17439580c452 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:13.055515 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b95b7687-dbfb-427c-973f-17439580c452 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:13.061322 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b95b7687-dbfb-427c-973f-17439580c452 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:13.061766 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b95b7687-dbfb-427c-973f-17439580c452 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:13.062534 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b95b7687-dbfb-427c-973f-17439580c452 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:13.062961 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b95b7687-dbfb-427c-973f-17439580c452 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:13.065715 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6f8d154b-c97e-42c7-8a33-74fbb27cb330 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.106696 Nov 23 14:34:13.067181 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 308/613] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:12 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:13.415090 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b95b7687-dbfb-427c-973f-17439580c452 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.363952 Nov 23 14:34:13.415860 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 306/614] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:13 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:34:13.998537 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-94a3ffce-0f66-443a-aa46-a78bebb2976a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:13.999221 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-94a3ffce-0f66-443a-aa46-a78bebb2976a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:14.007186 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-94a3ffce-0f66-443a-aa46-a78bebb2976a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:14.007632 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-94a3ffce-0f66-443a-aa46-a78bebb2976a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:14.008447 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-94a3ffce-0f66-443a-aa46-a78bebb2976a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:14.008927 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-94a3ffce-0f66-443a-aa46-a78bebb2976a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:14.078295 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6f7dcd76-08c9-4f56-a798-6b5b8f7cf345 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:14.079288 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6f7dcd76-08c9-4f56-a798-6b5b8f7cf345 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:14.087936 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6f7dcd76-08c9-4f56-a798-6b5b8f7cf345 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:14.090652 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6f7dcd76-08c9-4f56-a798-6b5b8f7cf345 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:14.090652 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6f7dcd76-08c9-4f56-a798-6b5b8f7cf345 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:14.090815 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6f7dcd76-08c9-4f56-a798-6b5b8f7cf345 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:14.097693 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-94a3ffce-0f66-443a-aa46-a78bebb2976a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c7b8ae9694a34823d2e45482ea928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cee3fc64784108bc54007c1c6c0ca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:14.107198 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-94a3ffce-0f66-443a-aa46-a78bebb2976a tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 200 len: 1478 microversion: 2.1 time: 0.112304 Nov 23 14:34:14.117219 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 309/615] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:13 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 1478 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:14.122502 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-a4ab8c8c-b46a-4801-b477-900cbe0ed12e req-ff35903b-c8b6-49bd-b305-e6ca0a06c0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6058aa9c-7bfb-4762-8055-36d2f3e29234", "name": "network-vif-deleted", "tag": "41917fa8-aec8-4d67-b659-2bd33221e38a"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:14.125274 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:34:14.125274 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:34:14.132813 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-a4ab8c8c-b46a-4801-b477-900cbe0ed12e req-ff35903b-c8b6-49bd-b305-e6ca0a06c0f1 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:14.133723 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-a4ab8c8c-b46a-4801-b477-900cbe0ed12e req-ff35903b-c8b6-49bd-b305-e6ca0a06c0f1 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:14.145327 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-a4ab8c8c-b46a-4801-b477-900cbe0ed12e req-ff35903b-c8b6-49bd-b305-e6ca0a06c0f1 service nova] Creating event network-vif-deleted:41917fa8-aec8-4d67-b659-2bd33221e38a for instance 6058aa9c-7bfb-4762-8055-36d2f3e29234 on hv-cinder-80475 Nov 23 14:34:14.150312 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-a4ab8c8c-b46a-4801-b477-900cbe0ed12e req-ff35903b-c8b6-49bd-b305-e6ca0a06c0f1 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031526 Nov 23 14:34:14.150902 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 310/616] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:34:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:34:14.175340 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6f7dcd76-08c9-4f56-a798-6b5b8f7cf345 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.100897 Nov 23 14:34:14.176217 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 307/617] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:14 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:14.428157 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-45bc8b69-5667-4ac1-921b-3159f3e8df7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:14.429275 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-45bc8b69-5667-4ac1-921b-3159f3e8df7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:14.435665 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45bc8b69-5667-4ac1-921b-3159f3e8df7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:14.436117 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45bc8b69-5667-4ac1-921b-3159f3e8df7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:14.440638 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45bc8b69-5667-4ac1-921b-3159f3e8df7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:14.440638 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45bc8b69-5667-4ac1-921b-3159f3e8df7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:14.509228 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-45bc8b69-5667-4ac1-921b-3159f3e8df7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.085194 Nov 23 14:34:14.511617 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 311/618] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:14 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:34:15.125993 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-01a94a0d-c3ba-4a6d-a43a-7ed47df141be tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:15.127254 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-01a94a0d-c3ba-4a6d-a43a-7ed47df141be tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] [instance: 6058aa9c-7bfb-4762-8055-36d2f3e29234] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:15.135168 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-01a94a0d-c3ba-4a6d-a43a-7ed47df141be tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:15.135618 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-01a94a0d-c3ba-4a6d-a43a-7ed47df141be tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:15.136450 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-01a94a0d-c3ba-4a6d-a43a-7ed47df141be tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:15.136965 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-01a94a0d-c3ba-4a6d-a43a-7ed47df141be tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:15.152175 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-01a94a0d-c3ba-4a6d-a43a-7ed47df141be tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] HTTP exception thrown: Instance 6058aa9c-7bfb-4762-8055-36d2f3e29234 could not be found. Nov 23 14:34:15.152797 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-01a94a0d-c3ba-4a6d-a43a-7ed47df141be tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] Returning 404 to user: Instance 6058aa9c-7bfb-4762-8055-36d2f3e29234 could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:34:15.153616 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-01a94a0d-c3ba-4a6d-a43a-7ed47df141be tempest-ServerRescueNegativeTestJSON-1635152025 tempest-ServerRescueNegativeTestJSON-1635152025-project] 10.222.0.82 "GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234" status: 404 len: 111 microversion: 2.1 time: 0.031866 Nov 23 14:34:15.154199 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 308/619] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:15 2021] GET /compute/v2.1/servers/6058aa9c-7bfb-4762-8055-36d2f3e29234 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:34:15.187537 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-645f4bc8-78eb-4d82-8fa2-7b8e50df3943 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:15.189639 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-645f4bc8-78eb-4d82-8fa2-7b8e50df3943 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:15.196178 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-645f4bc8-78eb-4d82-8fa2-7b8e50df3943 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:15.196665 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-645f4bc8-78eb-4d82-8fa2-7b8e50df3943 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:15.197440 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-645f4bc8-78eb-4d82-8fa2-7b8e50df3943 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:15.197876 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-645f4bc8-78eb-4d82-8fa2-7b8e50df3943 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:15.266273 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-645f4bc8-78eb-4d82-8fa2-7b8e50df3943 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.082756 Nov 23 14:34:15.270847 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 312/620] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:15 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:15.521456 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d3919fb0-7b23-42a7-be19-a85af864480e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:15.522405 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d3919fb0-7b23-42a7-be19-a85af864480e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:15.528626 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d3919fb0-7b23-42a7-be19-a85af864480e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:15.529067 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d3919fb0-7b23-42a7-be19-a85af864480e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:15.529832 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d3919fb0-7b23-42a7-be19-a85af864480e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:15.530260 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d3919fb0-7b23-42a7-be19-a85af864480e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:16.278989 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e41ec708-50bc-4662-9ebd-7287da833445 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:16.279983 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e41ec708-50bc-4662-9ebd-7287da833445 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:16.286898 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e41ec708-50bc-4662-9ebd-7287da833445 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:16.287343 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e41ec708-50bc-4662-9ebd-7287da833445 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:16.288124 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e41ec708-50bc-4662-9ebd-7287da833445 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:16.288584 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e41ec708-50bc-4662-9ebd-7287da833445 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:22.148212 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d3919fb0-7b23-42a7-be19-a85af864480e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 6.630758 Nov 23 14:34:22.152183 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 309/621] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:15 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 6632 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:22.155194 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e41ec708-50bc-4662-9ebd-7287da833445 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 5.880050 Nov 23 14:34:22.156184 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 313/622] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:16 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 5882 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:22.263786 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a0573f2f-937b-4e94-8768-e293236100dc tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] Action: 'create', calling method: .version_select at 0x7f208818ac10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-781046955", "metadata": {"Type": "work"}}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:22.265304 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a0573f2f-937b-4e94-8768-e293236100dc tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:34:22.266086 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a0573f2f-937b-4e94-8768-e293236100dc tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.116091 Nov 23 14:34:22.266607 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 310/623] 10.222.0.82 () {60 vars in 1155 bytes} [Tue Nov 23 14:34:22 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 14:34:22.276744 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2aee18c8-cc75-4189-91d5-4c23637f4b7b tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] Action: 'create', calling method: .version_select at 0x7f208801cdc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2037188718", "metadata": {"Type": "work"}}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:22.281053 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2aee18c8-cc75-4189-91d5-4c23637f4b7b tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:34:22.281053 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2aee18c8-cc75-4189-91d5-4c23637f4b7b tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006362 Nov 23 14:34:22.281053 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 314/624] 10.222.0.82 () {60 vars in 1155 bytes} [Tue Nov 23 14:34:22 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 14:34:22.289093 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b9893cd2-6b0d-4d67-ab7a-b628bf6e11e9 tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] Action: 'create', calling method: .version_select at 0x7f208818a3a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-758082185", "metadata": {"Type": "work"}}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:22.290448 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b9893cd2-6b0d-4d67-ab7a-b628bf6e11e9 tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:34:22.291224 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b9893cd2-6b0d-4d67-ab7a-b628bf6e11e9 tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006714 Nov 23 14:34:22.291726 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 311/625] 10.222.0.82 () {60 vars in 1155 bytes} [Tue Nov 23 14:34:22 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 14:34:22.300396 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e68b9a4b-21b1-4d35-a980-5977836eb5ef tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] Calling method '.version_select at 0x7f208814cca0>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:22.328763 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-e68b9a4b-21b1-4d35-a980-5977836eb5ef tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] HTTP exception thrown: Volume tempest-invalid-1773503090 could not be found. Nov 23 14:34:22.329334 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e68b9a4b-21b1-4d35-a980-5977836eb5ef tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] Returning 404 to user: Volume tempest-invalid-1773503090 could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:34:22.330130 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e68b9a4b-21b1-4d35-a980-5977836eb5ef tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1773503090" status: 404 len: 99 microversion: 2.1 time: 0.033698 Nov 23 14:34:22.330644 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 315/626] 10.222.0.82 () {58 vars in 1217 bytes} [Tue Nov 23 14:34:22 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1773503090 => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 23 14:34:22.339292 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3a961add-a8d0-4acb-bb9b-5953151b06d6 tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003520 Nov 23 14:34:22.339777 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 312/627] 10.222.0.82 () {58 vars in 1139 bytes} [Tue Nov 23 14:34:22 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 23 14:34:22.347846 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-19f2c788-4625-489e-ae56-68fc03196d6b tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003823 Nov 23 14:34:22.348350 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 316/628] 10.222.0.82 () {58 vars in 1136 bytes} [Tue Nov 23 14:34:22 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 23 14:34:22.356275 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-07d32146-2978-4fb0-88ec-ffb4985cc175 tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] Calling method '.version_select at 0x7f20880f7b80>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:22.384301 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-07d32146-2978-4fb0-88ec-ffb4985cc175 tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] HTTP exception thrown: Volume cd859be2-6e4e-4b68-ba37-586a7ae68913 could not be found. Nov 23 14:34:22.384902 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-07d32146-2978-4fb0-88ec-ffb4985cc175 tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] Returning 404 to user: Volume cd859be2-6e4e-4b68-ba37-586a7ae68913 could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:34:22.385760 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-07d32146-2978-4fb0-88ec-ffb4985cc175 tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/cd859be2-6e4e-4b68-ba37-586a7ae68913" status: 404 len: 109 microversion: 2.1 time: 0.032947 Nov 23 14:34:22.386397 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 313/629] 10.222.0.82 () {58 vars in 1247 bytes} [Tue Nov 23 14:34:22 2021] DELETE /compute/v2.1/os-volumes/cd859be2-6e4e-4b68-ba37-586a7ae68913 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:34:22.396117 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-20b1f97c-d919-40cd-8b9b-165b4314fb64 tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] Calling method '.version_select at 0x7f2088047b80>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:22.422227 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-20b1f97c-d919-40cd-8b9b-165b4314fb64 tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] HTTP exception thrown: Volume e283f5d1-3697-490e-8b66-5cd05081c123 could not be found. Nov 23 14:34:22.422814 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-20b1f97c-d919-40cd-8b9b-165b4314fb64 tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] Returning 404 to user: Volume e283f5d1-3697-490e-8b66-5cd05081c123 could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:34:22.423630 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-20b1f97c-d919-40cd-8b9b-165b4314fb64 tempest-VolumesNegativeTest-1995773507 tempest-VolumesNegativeTest-1995773507-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/e283f5d1-3697-490e-8b66-5cd05081c123" status: 404 len: 109 microversion: 2.1 time: 0.032164 Nov 23 14:34:22.424151 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 317/630] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Nov 23 14:34:22 2021] GET /compute/v2.1/os-volumes/e283f5d1-3697-490e-8b66-5cd05081c123 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:34:23.161517 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b25a3bd2-b949-406a-8abb-716aaa657290 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:23.162692 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b25a3bd2-b949-406a-8abb-716aaa657290 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:23.168643 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9d695d68-d22f-4326-aa14-bb69af0788c5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:23.169581 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b25a3bd2-b949-406a-8abb-716aaa657290 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:23.170098 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b25a3bd2-b949-406a-8abb-716aaa657290 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:23.170411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9d695d68-d22f-4326-aa14-bb69af0788c5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:23.171028 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b25a3bd2-b949-406a-8abb-716aaa657290 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:23.171657 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b25a3bd2-b949-406a-8abb-716aaa657290 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:23.176609 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9d695d68-d22f-4326-aa14-bb69af0788c5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:23.177672 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9d695d68-d22f-4326-aa14-bb69af0788c5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:23.178494 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9d695d68-d22f-4326-aa14-bb69af0788c5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:23.178937 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9d695d68-d22f-4326-aa14-bb69af0788c5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:23.281153 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b25a3bd2-b949-406a-8abb-716aaa657290 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.124307 Nov 23 14:34:23.282190 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 314/631] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:23 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:34:23.296480 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9d695d68-d22f-4326-aa14-bb69af0788c5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.132200 Nov 23 14:34:23.297928 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 318/632] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:23 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:24.293654 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b3cf7b06-e53b-499d-b736-6da0e8cc4d84 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:24.294658 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b3cf7b06-e53b-499d-b736-6da0e8cc4d84 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:24.301508 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b3cf7b06-e53b-499d-b736-6da0e8cc4d84 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:24.301957 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b3cf7b06-e53b-499d-b736-6da0e8cc4d84 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:24.302728 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b3cf7b06-e53b-499d-b736-6da0e8cc4d84 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:24.303161 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b3cf7b06-e53b-499d-b736-6da0e8cc4d84 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:24.309200 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-231c1b89-3f08-44fa-a6fe-0b7096eb08b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:24.310351 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-231c1b89-3f08-44fa-a6fe-0b7096eb08b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:24.319728 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-231c1b89-3f08-44fa-a6fe-0b7096eb08b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:24.320099 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-231c1b89-3f08-44fa-a6fe-0b7096eb08b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:24.321010 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-231c1b89-3f08-44fa-a6fe-0b7096eb08b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:24.321507 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-231c1b89-3f08-44fa-a6fe-0b7096eb08b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:24.419458 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b3cf7b06-e53b-499d-b736-6da0e8cc4d84 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.129801 Nov 23 14:34:24.423053 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 315/633] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:24 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:24.436350 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-231c1b89-3f08-44fa-a6fe-0b7096eb08b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.131170 Nov 23 14:34:24.437930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 319/634] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:24 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:24.722505 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d61759ba-684f-441a-b7c0-88d60f252a61 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b044062e-2dd3-45cb-8546-bba1597f762d"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:24.724537 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d61759ba-684f-441a-b7c0-88d60f252a61 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:24.731414 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d61759ba-684f-441a-b7c0-88d60f252a61 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:24.731867 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d61759ba-684f-441a-b7c0-88d60f252a61 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:24.732766 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d61759ba-684f-441a-b7c0-88d60f252a61 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:24.733198 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d61759ba-684f-441a-b7c0-88d60f252a61 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:24.812219 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-d61759ba-684f-441a-b7c0-88d60f252a61 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] HTTP exception thrown: Invalid volume: volume b044062e-2dd3-45cb-8546-bba1597f762d is already attached to instances: 1c214697-d673-4304-b403-6624296f8ef2 Nov 23 14:34:24.813131 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d61759ba-684f-441a-b7c0-88d60f252a61 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Returning 400 to user: Invalid volume: volume b044062e-2dd3-45cb-8546-bba1597f762d is already attached to instances: 1c214697-d673-4304-b403-6624296f8ef2 {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:34:24.814073 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d61759ba-684f-441a-b7c0-88d60f252a61 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "POST /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095674 Nov 23 14:34:24.814673 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 316/635] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Nov 23 14:34:24 2021] POST /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 14:34:24.878202 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-bb5dd88e-1933-4310-9f9a-ab934264bb55 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:24.879125 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-bb5dd88e-1933-4310-9f9a-ab934264bb55 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:24.887673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bb5dd88e-1933-4310-9f9a-ab934264bb55 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:24.888613 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bb5dd88e-1933-4310-9f9a-ab934264bb55 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:24.890430 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bb5dd88e-1933-4310-9f9a-ab934264bb55 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:24.891386 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bb5dd88e-1933-4310-9f9a-ab934264bb55 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:24.973248 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-bb5dd88e-1933-4310-9f9a-ab934264bb55 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lazy-loading 'services' on Instance uuid 1c214697-d673-4304-b403-6624296f8ef2 {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:34:25.171189 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-bb5dd88e-1933-4310-9f9a-ab934264bb55 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "DELETE /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2/os-volume_attachments/b044062e-2dd3-45cb-8546-bba1597f762d" status: 202 len: 0 microversion: 2.1 time: 0.297226 Nov 23 14:34:25.175034 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 320/636] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Nov 23 14:34:24 2021] DELETE /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2/os-volume_attachments/b044062e-2dd3-45cb-8546-bba1597f762d => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:25.181664 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-08d24238-41ae-4e83-88dc-91f0b782eba8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:25.182847 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-08d24238-41ae-4e83-88dc-91f0b782eba8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:25.191319 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-08d24238-41ae-4e83-88dc-91f0b782eba8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:25.191756 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-08d24238-41ae-4e83-88dc-91f0b782eba8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:25.193122 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-08d24238-41ae-4e83-88dc-91f0b782eba8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:25.193566 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-08d24238-41ae-4e83-88dc-91f0b782eba8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:25.226346 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-08d24238-41ae-4e83-88dc-91f0b782eba8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049831 Nov 23 14:34:25.226911 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 317/637] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:34:25 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:34:25.432580 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-31ff2fbc-ce22-40c3-9cc1-28487ddbaf1d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:25.433661 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-31ff2fbc-ce22-40c3-9cc1-28487ddbaf1d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:25.439930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-31ff2fbc-ce22-40c3-9cc1-28487ddbaf1d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:25.440401 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-31ff2fbc-ce22-40c3-9cc1-28487ddbaf1d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:25.441187 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-31ff2fbc-ce22-40c3-9cc1-28487ddbaf1d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:25.441613 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-31ff2fbc-ce22-40c3-9cc1-28487ddbaf1d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:25.448876 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6e852533-122f-41a5-aa34-43f3fc9bf3ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:25.449785 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6e852533-122f-41a5-aa34-43f3fc9bf3ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:25.456339 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6e852533-122f-41a5-aa34-43f3fc9bf3ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:25.456657 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6e852533-122f-41a5-aa34-43f3fc9bf3ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:25.457430 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6e852533-122f-41a5-aa34-43f3fc9bf3ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:25.458047 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6e852533-122f-41a5-aa34-43f3fc9bf3ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:31.322281 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6e852533-122f-41a5-aa34-43f3fc9bf3ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 5.876975 Nov 23 14:34:31.323287 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-31ff2fbc-ce22-40c3-9cc1-28487ddbaf1d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 5.891112 Nov 23 14:34:31.327140 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 318/639] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:25 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 5880 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:31.327362 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 321/639] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:25 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 5899 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:31.330050 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e185cab1-96ae-4dd7-a318-a93c7d15cbda tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:31.331060 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e185cab1-96ae-4dd7-a318-a93c7d15cbda tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:31.340132 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e185cab1-96ae-4dd7-a318-a93c7d15cbda tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:31.340647 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e185cab1-96ae-4dd7-a318-a93c7d15cbda tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:31.342177 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e185cab1-96ae-4dd7-a318-a93c7d15cbda tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:31.342177 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e185cab1-96ae-4dd7-a318-a93c7d15cbda tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:31.376221 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e185cab1-96ae-4dd7-a318-a93c7d15cbda tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049996 Nov 23 14:34:31.376861 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 319/640] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:34:31 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:34:32.338909 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-26014941-1725-4ed3-93f5-2717c16eb11b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:32.341789 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-660a5cf9-5151-4dc8-9ab1-986b52759685 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:32.342736 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-26014941-1725-4ed3-93f5-2717c16eb11b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:32.343554 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-660a5cf9-5151-4dc8-9ab1-986b52759685 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:32.356547 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-660a5cf9-5151-4dc8-9ab1-986b52759685 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:32.358263 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-26014941-1725-4ed3-93f5-2717c16eb11b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:32.358772 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-660a5cf9-5151-4dc8-9ab1-986b52759685 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:32.359629 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-660a5cf9-5151-4dc8-9ab1-986b52759685 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:32.360125 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-660a5cf9-5151-4dc8-9ab1-986b52759685 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:32.360624 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-26014941-1725-4ed3-93f5-2717c16eb11b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:32.362957 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-26014941-1725-4ed3-93f5-2717c16eb11b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:32.363355 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-26014941-1725-4ed3-93f5-2717c16eb11b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:32.427748 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-26014941-1725-4ed3-93f5-2717c16eb11b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.096240 Nov 23 14:34:32.429158 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 322/641] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:32 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:32.433346 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e1155832-cb20-40e8-8646-a72c31b508b5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:32.440582 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-660a5cf9-5151-4dc8-9ab1-986b52759685 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.101428 Nov 23 14:34:32.440730 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e1155832-cb20-40e8-8646-a72c31b508b5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:32.440834 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 320/642] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:32 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:32.441380 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e1155832-cb20-40e8-8646-a72c31b508b5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:32.441831 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e1155832-cb20-40e8-8646-a72c31b508b5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:32.442608 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e1155832-cb20-40e8-8646-a72c31b508b5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:32.443040 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e1155832-cb20-40e8-8646-a72c31b508b5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:32.475900 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e1155832-cb20-40e8-8646-a72c31b508b5 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046386 Nov 23 14:34:32.476484 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 323/643] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:34:32 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:34:33.440226 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-42e5b349-e783-4d1c-8e09-2b4be2fe8e40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:33.440707 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-42e5b349-e783-4d1c-8e09-2b4be2fe8e40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:33.448817 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-12e7331a-a253-4a74-905e-6b23e556d9bf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:33.449243 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-42e5b349-e783-4d1c-8e09-2b4be2fe8e40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:33.449425 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-42e5b349-e783-4d1c-8e09-2b4be2fe8e40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:33.450012 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-12e7331a-a253-4a74-905e-6b23e556d9bf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:33.450109 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-42e5b349-e783-4d1c-8e09-2b4be2fe8e40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:33.450550 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-42e5b349-e783-4d1c-8e09-2b4be2fe8e40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:33.457005 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-12e7331a-a253-4a74-905e-6b23e556d9bf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:33.457659 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-12e7331a-a253-4a74-905e-6b23e556d9bf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:33.458568 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-12e7331a-a253-4a74-905e-6b23e556d9bf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:33.459619 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-12e7331a-a253-4a74-905e-6b23e556d9bf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:33.533401 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-42e5b349-e783-4d1c-8e09-2b4be2fe8e40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.097906 Nov 23 14:34:33.537887 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 321/644] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:33 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:33.540086 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-70e3254a-3106-4559-89a0-6a6c2bede94c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:33.541095 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-70e3254a-3106-4559-89a0-6a6c2bede94c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:33.547833 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-70e3254a-3106-4559-89a0-6a6c2bede94c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:33.548301 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-70e3254a-3106-4559-89a0-6a6c2bede94c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:33.549072 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-70e3254a-3106-4559-89a0-6a6c2bede94c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:33.549500 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-70e3254a-3106-4559-89a0-6a6c2bede94c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:33.551172 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-12e7331a-a253-4a74-905e-6b23e556d9bf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.106732 Nov 23 14:34:33.551833 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 324/645] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:33 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:33.579335 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-70e3254a-3106-4559-89a0-6a6c2bede94c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043932 Nov 23 14:34:33.579892 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 322/646] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:34:33 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:34:33.727338 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f25b56f9-37aa-4c73-adcb-75cc41d34aa7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-905361585", "imageRef": "b06b9241-c147-436d-86bb-7c49ad8ef09c", "flavorRef": "452", "networks": [{"uuid": "91c21480-0f27-4f06-9850-471f208e0ee5"}]}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:33.778522 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.network.neutron [None req-f25b56f9-37aa-4c73-adcb-75cc41d34aa7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] validate_networks() for [('91c21480-0f27-4f06-9850-471f208e0ee5', None, None, None, None, None)] {{(pid=116787) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:34:34.140594 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-f25b56f9-37aa-4c73-adcb-75cc41d34aa7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Flavor limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:34:34.141012 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-f25b56f9-37aa-4c73-adcb-75cc41d34aa7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Image limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:34:34.141479 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-f25b56f9-37aa-4c73-adcb-75cc41d34aa7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Flavor pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:34:34.141880 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-f25b56f9-37aa-4c73-adcb-75cc41d34aa7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Image pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:34:34.142285 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-f25b56f9-37aa-4c73-adcb-75cc41d34aa7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:34:34.153131 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f25b56f9-37aa-4c73-adcb-75cc41d34aa7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:34.153571 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f25b56f9-37aa-4c73-adcb-75cc41d34aa7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:34.154373 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f25b56f9-37aa-4c73-adcb-75cc41d34aa7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:34.154803 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f25b56f9-37aa-4c73-adcb-75cc41d34aa7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:34.170999 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-f25b56f9-37aa-4c73-adcb-75cc41d34aa7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Getting quotas for project 368da8317e0d4261811a214a941624dc. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:34:34.174966 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-f25b56f9-37aa-4c73-adcb-75cc41d34aa7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Getting quotas for user a5f5f781b89d41e091d59e326a5e4db5 and project 368da8317e0d4261811a214a941624dc. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:34:34.187463 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f25b56f9-37aa-4c73-adcb-75cc41d34aa7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Going to run 1 instances... {{(pid=116787) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:34:34.189989 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f25b56f9-37aa-4c73-adcb-75cc41d34aa7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b06b9241-c147-436d-86bb-7c49ad8ef09c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:34:34.297710 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f25b56f9-37aa-4c73-adcb-75cc41d34aa7 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574470 Nov 23 14:34:34.298388 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 325/647] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:34:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 14:34:34.308079 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3ab42b93-bfd9-4a7f-86a0-f67ad6c22f92 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:34.308734 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3ab42b93-bfd9-4a7f-86a0-f67ad6c22f92 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:34.360905 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-3ab42b93-bfd9-4a7f-86a0-f67ad6c22f92 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:34.367949 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3ab42b93-bfd9-4a7f-86a0-f67ad6c22f92 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1217 microversion: 2.1 time: 0.063446 Nov 23 14:34:34.368785 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 323/648] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:34 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:34.545949 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1a3ec65a-0d1f-42fd-98ae-8a26ace9ac8d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:34.546907 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1a3ec65a-0d1f-42fd-98ae-8a26ace9ac8d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:34.554003 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1a3ec65a-0d1f-42fd-98ae-8a26ace9ac8d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:34.554389 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1a3ec65a-0d1f-42fd-98ae-8a26ace9ac8d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:34.555171 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1a3ec65a-0d1f-42fd-98ae-8a26ace9ac8d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:34.555618 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1a3ec65a-0d1f-42fd-98ae-8a26ace9ac8d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:34.562846 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-db2c0cf1-82ef-43ca-a965-99d837537062 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:34.563865 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-db2c0cf1-82ef-43ca-a965-99d837537062 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:34.573499 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-db2c0cf1-82ef-43ca-a965-99d837537062 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:34.573946 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-db2c0cf1-82ef-43ca-a965-99d837537062 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:34.574887 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-db2c0cf1-82ef-43ca-a965-99d837537062 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:34.575375 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-db2c0cf1-82ef-43ca-a965-99d837537062 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:36.387247 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1a3ec65a-0d1f-42fd-98ae-8a26ace9ac8d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 1.843983 Nov 23 14:34:36.388350 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 326/649] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:34 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:36.393464 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3be562f2-7c41-4326-8797-b9776cc29b94 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:36.394152 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3be562f2-7c41-4326-8797-b9776cc29b94 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:36.397710 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-db2c0cf1-82ef-43ca-a965-99d837537062 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 1.838417 Nov 23 14:34:36.399365 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 324/650] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:34 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:36.404262 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3be562f2-7c41-4326-8797-b9776cc29b94 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:36.404740 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3be562f2-7c41-4326-8797-b9776cc29b94 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:36.405536 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3be562f2-7c41-4326-8797-b9776cc29b94 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:36.405974 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3be562f2-7c41-4326-8797-b9776cc29b94 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:36.474248 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3be562f2-7c41-4326-8797-b9776cc29b94 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:36.482902 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3be562f2-7c41-4326-8797-b9776cc29b94 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1221 microversion: 2.1 time: 0.093535 Nov 23 14:34:36.483453 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 327/651] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:36 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:37.399349 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-620f3e90-9bad-48d0-beb5-ec5e16efe046 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:37.400405 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-620f3e90-9bad-48d0-beb5-ec5e16efe046 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:37.407981 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-620f3e90-9bad-48d0-beb5-ec5e16efe046 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:37.407981 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-620f3e90-9bad-48d0-beb5-ec5e16efe046 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:37.408420 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-620f3e90-9bad-48d0-beb5-ec5e16efe046 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:37.408856 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-620f3e90-9bad-48d0-beb5-ec5e16efe046 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:37.411274 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-fe9a210c-541e-471d-bbd6-da5619f9057e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:37.412569 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-fe9a210c-541e-471d-bbd6-da5619f9057e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:37.419235 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fe9a210c-541e-471d-bbd6-da5619f9057e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:37.419801 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fe9a210c-541e-471d-bbd6-da5619f9057e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:37.420996 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fe9a210c-541e-471d-bbd6-da5619f9057e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:37.421625 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fe9a210c-541e-471d-bbd6-da5619f9057e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:37.946133 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-fe9a210c-541e-471d-bbd6-da5619f9057e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.539320 Nov 23 14:34:37.947166 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 328/652] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:37 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:37.952000 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-dd47b82b-6ddc-4015-b555-687d33d4a8d6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:37.952733 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-dd47b82b-6ddc-4015-b555-687d33d4a8d6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:37.960494 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dd47b82b-6ddc-4015-b555-687d33d4a8d6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:37.960939 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dd47b82b-6ddc-4015-b555-687d33d4a8d6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:37.961766 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dd47b82b-6ddc-4015-b555-687d33d4a8d6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:37.962208 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dd47b82b-6ddc-4015-b555-687d33d4a8d6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:37.978377 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-620f3e90-9bad-48d0-beb5-ec5e16efe046 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.582836 Nov 23 14:34:37.982826 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 325/653] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:37 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:38.023945 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-dd47b82b-6ddc-4015-b555-687d33d4a8d6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:38.031644 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-dd47b82b-6ddc-4015-b555-687d33d4a8d6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1221 microversion: 2.1 time: 0.083241 Nov 23 14:34:38.032317 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 329/654] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:37 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:38.958359 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-17f5dcac-7106-44a7-abb8-7439c58d4dd5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:38.959385 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-17f5dcac-7106-44a7-abb8-7439c58d4dd5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:38.966655 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-17f5dcac-7106-44a7-abb8-7439c58d4dd5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:38.967104 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-17f5dcac-7106-44a7-abb8-7439c58d4dd5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:38.968032 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-17f5dcac-7106-44a7-abb8-7439c58d4dd5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:38.968443 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-17f5dcac-7106-44a7-abb8-7439c58d4dd5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:38.992622 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-04c39b6d-1c25-41e6-b5dc-8664053f8830 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:38.993536 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-04c39b6d-1c25-41e6-b5dc-8664053f8830 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:38.999730 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-04c39b6d-1c25-41e6-b5dc-8664053f8830 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:39.000171 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-04c39b6d-1c25-41e6-b5dc-8664053f8830 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:39.000991 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-04c39b6d-1c25-41e6-b5dc-8664053f8830 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:39.001426 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-04c39b6d-1c25-41e6-b5dc-8664053f8830 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:39.057952 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-17f5dcac-7106-44a7-abb8-7439c58d4dd5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.103825 Nov 23 14:34:39.058707 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 326/655] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:38 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:39.063564 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5413a19a-833e-4663-b158-e8e5449bd5e8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:39.064471 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5413a19a-833e-4663-b158-e8e5449bd5e8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:39.072014 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5413a19a-833e-4663-b158-e8e5449bd5e8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:39.072546 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5413a19a-833e-4663-b158-e8e5449bd5e8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:39.073283 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5413a19a-833e-4663-b158-e8e5449bd5e8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:39.073711 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5413a19a-833e-4663-b158-e8e5449bd5e8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:39.090672 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-04c39b6d-1c25-41e6-b5dc-8664053f8830 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.102508 Nov 23 14:34:39.091633 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 330/656] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:38 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:34:39.135468 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5413a19a-833e-4663-b158-e8e5449bd5e8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:39.142990 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5413a19a-833e-4663-b158-e8e5449bd5e8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1269 microversion: 2.1 time: 0.083193 Nov 23 14:34:39.143552 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 327/657] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:39 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1269 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:40.071479 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ed310be8-a73a-4ba4-8fa9-af1cdc59cda1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:40.072825 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ed310be8-a73a-4ba4-8fa9-af1cdc59cda1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:40.079900 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ed310be8-a73a-4ba4-8fa9-af1cdc59cda1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:40.080605 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ed310be8-a73a-4ba4-8fa9-af1cdc59cda1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:40.081542 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ed310be8-a73a-4ba4-8fa9-af1cdc59cda1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:40.082033 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ed310be8-a73a-4ba4-8fa9-af1cdc59cda1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:40.103073 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9923fd46-153f-449f-8b0c-f51e55494ad2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:40.103990 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9923fd46-153f-449f-8b0c-f51e55494ad2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:40.111170 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9923fd46-153f-449f-8b0c-f51e55494ad2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:40.112005 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9923fd46-153f-449f-8b0c-f51e55494ad2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:40.112822 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9923fd46-153f-449f-8b0c-f51e55494ad2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:40.113265 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9923fd46-153f-449f-8b0c-f51e55494ad2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:40.152467 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ed310be8-a73a-4ba4-8fa9-af1cdc59cda1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.086215 Nov 23 14:34:40.158253 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 331/658] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:40 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:40.161891 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-23ccd7c6-1506-4e4f-8178-8f029d5b7ab0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:40.162692 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-23ccd7c6-1506-4e4f-8178-8f029d5b7ab0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:40.169463 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-23ccd7c6-1506-4e4f-8178-8f029d5b7ab0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:40.169914 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-23ccd7c6-1506-4e4f-8178-8f029d5b7ab0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:40.170699 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-23ccd7c6-1506-4e4f-8178-8f029d5b7ab0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:40.171138 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-23ccd7c6-1506-4e4f-8178-8f029d5b7ab0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:40.200244 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9923fd46-153f-449f-8b0c-f51e55494ad2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.100639 Nov 23 14:34:40.202214 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 328/659] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:40 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:34:40.613327 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-23ccd7c6-1506-4e4f-8178-8f029d5b7ab0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:40.621271 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-23ccd7c6-1506-4e4f-8178-8f029d5b7ab0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1317 microversion: 2.1 time: 0.465026 Nov 23 14:34:40.621829 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 332/660] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:40 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:34:41.166935 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-60e654e9-bfce-4523-b892-db86e2e676a7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:41.168033 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-60e654e9-bfce-4523-b892-db86e2e676a7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:41.174915 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-60e654e9-bfce-4523-b892-db86e2e676a7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:41.175368 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-60e654e9-bfce-4523-b892-db86e2e676a7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:41.176205 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-60e654e9-bfce-4523-b892-db86e2e676a7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:41.176727 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-60e654e9-bfce-4523-b892-db86e2e676a7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:41.212793 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3662c198-3f7d-40f7-844e-1cf1b28be0bf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:41.213819 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3662c198-3f7d-40f7-844e-1cf1b28be0bf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:41.219992 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3662c198-3f7d-40f7-844e-1cf1b28be0bf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:41.220547 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3662c198-3f7d-40f7-844e-1cf1b28be0bf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:41.221427 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3662c198-3f7d-40f7-844e-1cf1b28be0bf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:41.221934 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3662c198-3f7d-40f7-844e-1cf1b28be0bf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:41.492647 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-60e654e9-bfce-4523-b892-db86e2e676a7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28589 microversion: 2.1 time: 0.330416 Nov 23 14:34:41.496914 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 329/661] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:41 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28589 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:41.498452 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-1f307ed0-abda-4bef-aa5f-ab9c493b3f72 req-397c819b-5bc9-4ab8-9f21-d06d96b9fa02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "debd017d-9965-4cc4-8998-8827fb2a1072", "tag": "740e4a45-0299-43d8-aef2-b8d7f6c87383"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:41.499895 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:34:41.499895 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:34:41.508629 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-1f307ed0-abda-4bef-aa5f-ab9c493b3f72 req-397c819b-5bc9-4ab8-9f21-d06d96b9fa02 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:41.509150 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-1f307ed0-abda-4bef-aa5f-ab9c493b3f72 req-397c819b-5bc9-4ab8-9f21-d06d96b9fa02 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:41.512902 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3662c198-3f7d-40f7-844e-1cf1b28be0bf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.304423 Nov 23 14:34:41.514699 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 333/662] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:41 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:34:41.520354 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-1f307ed0-abda-4bef-aa5f-ab9c493b3f72 req-397c819b-5bc9-4ab8-9f21-d06d96b9fa02 service nova] Creating event network-changed:740e4a45-0299-43d8-aef2-b8d7f6c87383 for instance debd017d-9965-4cc4-8998-8827fb2a1072 on hv-cinder-80475 Nov 23 14:34:41.526026 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-1f307ed0-abda-4bef-aa5f-ab9c493b3f72 req-397c819b-5bc9-4ab8-9f21-d06d96b9fa02 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031220 Nov 23 14:34:41.526728 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 330/663] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:34:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:34:41.638982 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9b16d8c7-7f82-4bb6-b702-beca31f2bdac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:41.639735 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9b16d8c7-7f82-4bb6-b702-beca31f2bdac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:41.646189 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9b16d8c7-7f82-4bb6-b702-beca31f2bdac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:41.646638 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9b16d8c7-7f82-4bb6-b702-beca31f2bdac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:41.647473 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9b16d8c7-7f82-4bb6-b702-beca31f2bdac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:41.647908 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9b16d8c7-7f82-4bb6-b702-beca31f2bdac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:41.867199 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9b16d8c7-7f82-4bb6-b702-beca31f2bdac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:41.874806 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9b16d8c7-7f82-4bb6-b702-beca31f2bdac tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1317 microversion: 2.1 time: 0.239839 Nov 23 14:34:41.875470 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 334/664] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:41 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:42.505890 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3e8ddfcc-3206-451a-9bea-b1a6b857ef1b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:42.506813 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3e8ddfcc-3206-451a-9bea-b1a6b857ef1b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:42.512787 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3e8ddfcc-3206-451a-9bea-b1a6b857ef1b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:42.513231 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3e8ddfcc-3206-451a-9bea-b1a6b857ef1b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:42.514003 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3e8ddfcc-3206-451a-9bea-b1a6b857ef1b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:42.514435 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3e8ddfcc-3206-451a-9bea-b1a6b857ef1b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:42.525228 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-199b32ed-d1ef-49e3-9d9d-29e292611ae4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:42.526144 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-199b32ed-d1ef-49e3-9d9d-29e292611ae4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:42.532541 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-199b32ed-d1ef-49e3-9d9d-29e292611ae4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:42.532992 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-199b32ed-d1ef-49e3-9d9d-29e292611ae4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:42.534308 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-199b32ed-d1ef-49e3-9d9d-29e292611ae4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:42.534532 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-199b32ed-d1ef-49e3-9d9d-29e292611ae4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:42.709025 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3e8ddfcc-3206-451a-9bea-b1a6b857ef1b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 28956 microversion: 2.1 time: 0.207479 Nov 23 14:34:42.709768 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 331/665] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:42 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 28956 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:42.723261 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-199b32ed-d1ef-49e3-9d9d-29e292611ae4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.202039 Nov 23 14:34:42.724052 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 335/666] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:42 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:34:42.815881 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-33766273-e92c-4155-9977-9736bca79fe4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-223954505", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2032644991", "security_groups": [{"name": "tempest-secgroup-smoke-1968714706"}], "networks": [{"uuid": "96de613f-b0df-463c-b9eb-c71994d0999f"}], "block_device_mapping_v2": [{"uuid": "be95b86e-7d7d-4910-bdbe-0c9b40536add", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:42.892702 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e64f91fa-a026-46d7-a16e-65e674deff8d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:42.893519 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e64f91fa-a026-46d7-a16e-65e674deff8d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:42.901260 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e64f91fa-a026-46d7-a16e-65e674deff8d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:42.901709 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e64f91fa-a026-46d7-a16e-65e674deff8d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:42.902488 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e64f91fa-a026-46d7-a16e-65e674deff8d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:42.902922 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e64f91fa-a026-46d7-a16e-65e674deff8d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:42.929647 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.network.neutron [None req-33766273-e92c-4155-9977-9736bca79fe4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] validate_networks() for [('96de613f-b0df-463c-b9eb-c71994d0999f', None, None, None, None, None)] {{(pid=116788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:34:43.045021 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e64f91fa-a026-46d7-a16e-65e674deff8d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:43.052389 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e64f91fa-a026-46d7-a16e-65e674deff8d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1317 microversion: 2.1 time: 0.163799 Nov 23 14:34:43.052950 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 336/667] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:42 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:43.301398 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-33766273-e92c-4155-9977-9736bca79fe4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Flavor limits 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:34:43.301813 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-33766273-e92c-4155-9977-9736bca79fe4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Image limits 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:34:43.302279 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-33766273-e92c-4155-9977-9736bca79fe4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Flavor pref 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:34:43.302783 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-33766273-e92c-4155-9977-9736bca79fe4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Image pref 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:34:43.303180 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-33766273-e92c-4155-9977-9736bca79fe4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:34:43.311817 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-33766273-e92c-4155-9977-9736bca79fe4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:43.312287 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-33766273-e92c-4155-9977-9736bca79fe4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:43.313090 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-33766273-e92c-4155-9977-9736bca79fe4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:43.313517 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-33766273-e92c-4155-9977-9736bca79fe4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:43.329488 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-33766273-e92c-4155-9977-9736bca79fe4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Getting quotas for project c62f306655ec464f9295fc94d9ce4e1a. Resources: {'instances', 'cores', 'ram'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:34:43.333293 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-33766273-e92c-4155-9977-9736bca79fe4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Getting quotas for user 080e264b5b294d37b944f74ec75fb5bc and project c62f306655ec464f9295fc94d9ce4e1a. Resources: {'instances', 'cores', 'ram'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:34:43.388346 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-33766273-e92c-4155-9977-9736bca79fe4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Going to run 1 instances... {{(pid=116788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:34:43.390815 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-33766273-e92c-4155-9977-9736bca79fe4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be95b86e-7d7d-4910-bdbe-0c9b40536add',volume_size=None,volume_type=None)] {{(pid=116788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:34:43.720791 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-01666340-e2fd-4193-a296-4a30847dfd07 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:43.721918 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-01666340-e2fd-4193-a296-4a30847dfd07 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:43.728039 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-01666340-e2fd-4193-a296-4a30847dfd07 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:43.728624 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-01666340-e2fd-4193-a296-4a30847dfd07 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:43.729462 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-01666340-e2fd-4193-a296-4a30847dfd07 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:43.729890 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-01666340-e2fd-4193-a296-4a30847dfd07 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:43.835295 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-33766273-e92c-4155-9977-9736bca79fe4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.023405 Nov 23 14:34:43.835935 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 332/668] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:34:42 2021] POST /compute/v2.1/servers => generated 406 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 14:34:43.840788 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e4dbf9bb-9039-4244-9958-d7a2886bcee2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:43.841415 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e4dbf9bb-9039-4244-9958-d7a2886bcee2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:43.847663 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e4dbf9bb-9039-4244-9958-d7a2886bcee2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:43.848111 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e4dbf9bb-9039-4244-9958-d7a2886bcee2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:43.848926 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e4dbf9bb-9039-4244-9958-d7a2886bcee2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:43.849355 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e4dbf9bb-9039-4244-9958-d7a2886bcee2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:43.850103 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-01666340-e2fd-4193-a296-4a30847dfd07 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 30894 microversion: 2.1 time: 0.132738 Nov 23 14:34:43.852877 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 337/669] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:43 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 30894 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:43.858948 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-393c317b-1250-491b-9d1e-57c44bbea128 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:43.858948 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-393c317b-1250-491b-9d1e-57c44bbea128 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:43.922634 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-393c317b-1250-491b-9d1e-57c44bbea128 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:43.922840 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e4dbf9bb-9039-4244-9958-d7a2886bcee2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.085525 Nov 23 14:34:43.923381 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 333/670] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:43 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:43.932257 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-393c317b-1250-491b-9d1e-57c44bbea128 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1088 microversion: 2.1 time: 0.080301 Nov 23 14:34:43.932845 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 338/671] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:43 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:44.070511 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bbe1e9f2-08a3-4a23-87e8-eb6adb71c429 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:44.071578 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bbe1e9f2-08a3-4a23-87e8-eb6adb71c429 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:44.078608 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bbe1e9f2-08a3-4a23-87e8-eb6adb71c429 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:44.079058 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bbe1e9f2-08a3-4a23-87e8-eb6adb71c429 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:44.079839 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bbe1e9f2-08a3-4a23-87e8-eb6adb71c429 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:44.080339 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bbe1e9f2-08a3-4a23-87e8-eb6adb71c429 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:44.166925 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e7c91ecf-e6a7-4e4d-8ee9-b0002006bd80 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:44.167695 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e7c91ecf-e6a7-4e4d-8ee9-b0002006bd80 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:44.174568 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e7c91ecf-e6a7-4e4d-8ee9-b0002006bd80 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:44.174993 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e7c91ecf-e6a7-4e4d-8ee9-b0002006bd80 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:44.175948 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e7c91ecf-e6a7-4e4d-8ee9-b0002006bd80 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:44.176418 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e7c91ecf-e6a7-4e4d-8ee9-b0002006bd80 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:44.232760 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-bbe1e9f2-08a3-4a23-87e8-eb6adb71c429 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:44.240161 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bbe1e9f2-08a3-4a23-87e8-eb6adb71c429 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1317 microversion: 2.1 time: 0.174444 Nov 23 14:34:44.242818 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 334/672] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:44 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:44.259693 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-e7c91ecf-e6a7-4e4d-8ee9-b0002006bd80 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lazy-loading 'services' on Instance uuid 66d63f1e-28e8-4644-a848-e1c1820b86f1 {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:34:44.470683 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e7c91ecf-e6a7-4e4d-8ee9-b0002006bd80 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "DELETE /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1/os-volume_attachments/3e600387-d573-4461-b700-5411d326c501" status: 202 len: 0 microversion: 2.1 time: 0.308409 Nov 23 14:34:44.471266 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 339/673] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Nov 23 14:34:44 2021] DELETE /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1/os-volume_attachments/3e600387-d573-4461-b700-5411d326c501 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:34:44.868410 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ada299d6-218c-4dc0-969c-986da8e0d09d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:44.869425 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ada299d6-218c-4dc0-969c-986da8e0d09d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:44.875636 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ada299d6-218c-4dc0-969c-986da8e0d09d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:44.876072 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ada299d6-218c-4dc0-969c-986da8e0d09d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:44.876872 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ada299d6-218c-4dc0-969c-986da8e0d09d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:44.877295 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ada299d6-218c-4dc0-969c-986da8e0d09d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:44.934606 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2cee2480-dadf-4fee-b32f-b852b6925bb2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:44.935696 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2cee2480-dadf-4fee-b32f-b852b6925bb2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:44.942121 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2cee2480-dadf-4fee-b32f-b852b6925bb2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:44.942597 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2cee2480-dadf-4fee-b32f-b852b6925bb2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:44.943373 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2cee2480-dadf-4fee-b32f-b852b6925bb2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:44.943824 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2cee2480-dadf-4fee-b32f-b852b6925bb2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:44.982020 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ada299d6-218c-4dc0-969c-986da8e0d09d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 32710 microversion: 2.1 time: 0.117883 Nov 23 14:34:44.986004 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 335/674] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:44 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 32710 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:44.987426 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-75ae639c-0366-4f73-ac61-b1a74b07c766 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:44.988107 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-75ae639c-0366-4f73-ac61-b1a74b07c766 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:44.995894 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-75ae639c-0366-4f73-ac61-b1a74b07c766 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:44.996383 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-75ae639c-0366-4f73-ac61-b1a74b07c766 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:44.997187 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-75ae639c-0366-4f73-ac61-b1a74b07c766 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:44.997662 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-75ae639c-0366-4f73-ac61-b1a74b07c766 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:45.058720 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-75ae639c-0366-4f73-ac61-b1a74b07c766 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:45.065941 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-75ae639c-0366-4f73-ac61-b1a74b07c766 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1138 microversion: 2.1 time: 0.082208 Nov 23 14:34:45.066513 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 336/675] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:44 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1138 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:45.135708 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2cee2480-dadf-4fee-b32f-b852b6925bb2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28653 microversion: 2.20 time: 0.204958 Nov 23 14:34:45.136309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 340/676] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:44 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28653 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:34:45.257498 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a57211c8-eba8-4444-a459-d44e7ea57bb3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:45.258103 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a57211c8-eba8-4444-a459-d44e7ea57bb3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:45.264587 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a57211c8-eba8-4444-a459-d44e7ea57bb3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:45.265087 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a57211c8-eba8-4444-a459-d44e7ea57bb3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:45.266059 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a57211c8-eba8-4444-a459-d44e7ea57bb3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:45.266495 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a57211c8-eba8-4444-a459-d44e7ea57bb3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:45.407551 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a57211c8-eba8-4444-a459-d44e7ea57bb3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:45.410404 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a57211c8-eba8-4444-a459-d44e7ea57bb3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1317 microversion: 2.1 time: 0.157149 Nov 23 14:34:45.410976 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 337/677] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:45 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:45.994981 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-dd469cd1-c7d4-4245-9701-b6c226d61e2a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:45.996066 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-dd469cd1-c7d4-4245-9701-b6c226d61e2a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:46.003966 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dd469cd1-c7d4-4245-9701-b6c226d61e2a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:46.004442 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dd469cd1-c7d4-4245-9701-b6c226d61e2a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:46.006600 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dd469cd1-c7d4-4245-9701-b6c226d61e2a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:46.007095 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dd469cd1-c7d4-4245-9701-b6c226d61e2a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:46.082657 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-17d386b5-dcc8-427a-b3a8-c6d5edb39557 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:46.085573 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-17d386b5-dcc8-427a-b3a8-c6d5edb39557 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:46.088156 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-dd469cd1-c7d4-4245-9701-b6c226d61e2a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 33544 microversion: 2.1 time: 0.097739 Nov 23 14:34:46.089015 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 341/678] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:45 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 33544 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:46.091704 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-17d386b5-dcc8-427a-b3a8-c6d5edb39557 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:46.092285 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-17d386b5-dcc8-427a-b3a8-c6d5edb39557 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:46.092976 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-17d386b5-dcc8-427a-b3a8-c6d5edb39557 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:46.093416 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-17d386b5-dcc8-427a-b3a8-c6d5edb39557 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:46.150303 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-84569712-db52-4728-b234-78fd7bce2c33 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:46.152161 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-84569712-db52-4728-b234-78fd7bce2c33 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:46.159003 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84569712-db52-4728-b234-78fd7bce2c33 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:46.159456 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84569712-db52-4728-b234-78fd7bce2c33 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:46.160262 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84569712-db52-4728-b234-78fd7bce2c33 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:46.160862 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84569712-db52-4728-b234-78fd7bce2c33 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:46.167163 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-17d386b5-dcc8-427a-b3a8-c6d5edb39557 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:46.175397 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-17d386b5-dcc8-427a-b3a8-c6d5edb39557 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1194 microversion: 2.1 time: 0.096321 Nov 23 14:34:46.175955 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 338/679] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:46 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1194 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:34:46.254704 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-84569712-db52-4728-b234-78fd7bce2c33 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 28987 microversion: 2.20 time: 0.109022 Nov 23 14:34:46.255664 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 342/680] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:46 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 28987 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:46.428372 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5cfa1653-39fa-462a-a3a0-7371a1df9bc9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:46.428977 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5cfa1653-39fa-462a-a3a0-7371a1df9bc9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:46.434872 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5cfa1653-39fa-462a-a3a0-7371a1df9bc9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:46.435405 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5cfa1653-39fa-462a-a3a0-7371a1df9bc9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:46.436185 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5cfa1653-39fa-462a-a3a0-7371a1df9bc9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:46.436642 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5cfa1653-39fa-462a-a3a0-7371a1df9bc9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:46.598104 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5cfa1653-39fa-462a-a3a0-7371a1df9bc9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:46.606801 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5cfa1653-39fa-462a-a3a0-7371a1df9bc9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1317 microversion: 2.1 time: 0.182568 Nov 23 14:34:46.607378 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 339/681] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:46 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:46.884474 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0cde0fda-081f-4a14-a59c-fb0f97061743 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:46.885144 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0cde0fda-081f-4a14-a59c-fb0f97061743 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:46.891373 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0cde0fda-081f-4a14-a59c-fb0f97061743 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:46.891872 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0cde0fda-081f-4a14-a59c-fb0f97061743 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:46.892685 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0cde0fda-081f-4a14-a59c-fb0f97061743 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:46.893117 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0cde0fda-081f-4a14-a59c-fb0f97061743 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:46.921571 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0cde0fda-081f-4a14-a59c-fb0f97061743 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Going to try to terminate instance {{(pid=116787) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:34:47.102735 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-20b24f80-256f-4344-87a3-8d91017b5afe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:47.104540 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-20b24f80-256f-4344-87a3-8d91017b5afe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:47.113219 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-20b24f80-256f-4344-87a3-8d91017b5afe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:47.114029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-20b24f80-256f-4344-87a3-8d91017b5afe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:47.115576 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-20b24f80-256f-4344-87a3-8d91017b5afe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:47.116217 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-20b24f80-256f-4344-87a3-8d91017b5afe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:47.228861 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-20b24f80-256f-4344-87a3-8d91017b5afe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 34251 microversion: 2.1 time: 0.131599 Nov 23 14:34:47.230041 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 340/682] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:47 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 34251 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:47.239214 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-01a5460e-b8f7-475b-8251-3b58f8daf69b tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:47.239214 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-01a5460e-b8f7-475b-8251-3b58f8daf69b tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:47.243946 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-01a5460e-b8f7-475b-8251-3b58f8daf69b tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:47.244503 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-01a5460e-b8f7-475b-8251-3b58f8daf69b tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:47.245358 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-01a5460e-b8f7-475b-8251-3b58f8daf69b tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:47.245859 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-01a5460e-b8f7-475b-8251-3b58f8daf69b tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:47.260174 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0cde0fda-081f-4a14-a59c-fb0f97061743 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "DELETE /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 204 len: 0 microversion: 2.1 time: 0.379369 Nov 23 14:34:47.264014 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 343/683] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:34:46 2021] DELETE /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 14:34:47.269470 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1f787a9e-cd5c-4e13-81e9-bedd0283ea3a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:47.270286 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1f787a9e-cd5c-4e13-81e9-bedd0283ea3a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:47.281108 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1f787a9e-cd5c-4e13-81e9-bedd0283ea3a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:47.282060 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1f787a9e-cd5c-4e13-81e9-bedd0283ea3a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:47.283216 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1f787a9e-cd5c-4e13-81e9-bedd0283ea3a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:47.283976 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1f787a9e-cd5c-4e13-81e9-bedd0283ea3a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:47.412624 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-01a5460e-b8f7-475b-8251-3b58f8daf69b tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:47.420136 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-01a5460e-b8f7-475b-8251-3b58f8daf69b tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1272 microversion: 2.1 time: 0.188715 Nov 23 14:34:47.420742 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 341/684] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:47 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:47.429757 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ffb09d95-aaf6-432d-b924-cb9252000fea tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:47.429757 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ffb09d95-aaf6-432d-b924-cb9252000fea tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:47.432820 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ffb09d95-aaf6-432d-b924-cb9252000fea tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:47.433274 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ffb09d95-aaf6-432d-b924-cb9252000fea tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:47.434065 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ffb09d95-aaf6-432d-b924-cb9252000fea tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:47.434504 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ffb09d95-aaf6-432d-b924-cb9252000fea tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:47.455811 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1f787a9e-cd5c-4e13-81e9-bedd0283ea3a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 30606 microversion: 2.20 time: 0.192272 Nov 23 14:34:47.456489 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 344/685] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:47 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 30606 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:34:47.583151 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ffb09d95-aaf6-432d-b924-cb9252000fea tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:47.592695 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ffb09d95-aaf6-432d-b924-cb9252000fea tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1514 microversion: 2.1 time: 0.170911 Nov 23 14:34:47.593836 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 342/686] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:47 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:47.625154 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-621eba3d-90ef-4f76-8352-b904c8a65de4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:47.625854 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-621eba3d-90ef-4f76-8352-b904c8a65de4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:47.633203 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-621eba3d-90ef-4f76-8352-b904c8a65de4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:47.633645 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-621eba3d-90ef-4f76-8352-b904c8a65de4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:47.634621 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-621eba3d-90ef-4f76-8352-b904c8a65de4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:47.635217 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-621eba3d-90ef-4f76-8352-b904c8a65de4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:47.850303 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-621eba3d-90ef-4f76-8352-b904c8a65de4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:47.857380 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-621eba3d-90ef-4f76-8352-b904c8a65de4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1317 microversion: 2.1 time: 0.236382 Nov 23 14:34:47.857934 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 345/687] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:47 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:47.938102 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-7f176dd8-5deb-4acb-bd0b-70d96f3ff6d6 req-01dd40c8-3536-4990-a03b-c6d87770076a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d82b41-cf80-4881-975e-eb1d71b0efc7", "tag": "20c986d1-94ea-44c7-9233-9b2ae752b164"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:47.940610 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:34:47.940610 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:34:47.950061 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-7f176dd8-5deb-4acb-bd0b-70d96f3ff6d6 req-01dd40c8-3536-4990-a03b-c6d87770076a service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:47.950776 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-7f176dd8-5deb-4acb-bd0b-70d96f3ff6d6 req-01dd40c8-3536-4990-a03b-c6d87770076a service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:47.965003 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-7f176dd8-5deb-4acb-bd0b-70d96f3ff6d6 req-01dd40c8-3536-4990-a03b-c6d87770076a service nova] Creating event network-changed:20c986d1-94ea-44c7-9233-9b2ae752b164 for instance 09d82b41-cf80-4881-975e-eb1d71b0efc7 on hv-cinder-80475 Nov 23 14:34:47.971659 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-7f176dd8-5deb-4acb-bd0b-70d96f3ff6d6 req-01dd40c8-3536-4990-a03b-c6d87770076a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037301 Nov 23 14:34:47.971659 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 343/688] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:34:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:34:48.241651 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8a14414f-8383-4013-9eef-cff811ed9268 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:48.242702 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8a14414f-8383-4013-9eef-cff811ed9268 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:48.249137 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8a14414f-8383-4013-9eef-cff811ed9268 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:48.249656 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8a14414f-8383-4013-9eef-cff811ed9268 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:48.250443 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8a14414f-8383-4013-9eef-cff811ed9268 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:48.250917 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8a14414f-8383-4013-9eef-cff811ed9268 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:48.350873 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8a14414f-8383-4013-9eef-cff811ed9268 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 35148 microversion: 2.1 time: 0.113469 Nov 23 14:34:48.351406 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 346/689] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:48 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 35148 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:48.437845 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7dedbd95-d1a6-42eb-b1a8-0d0af8ef4225 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:48.438667 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7dedbd95-d1a6-42eb-b1a8-0d0af8ef4225 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:48.445197 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7dedbd95-d1a6-42eb-b1a8-0d0af8ef4225 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:48.445708 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7dedbd95-d1a6-42eb-b1a8-0d0af8ef4225 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:48.446564 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7dedbd95-d1a6-42eb-b1a8-0d0af8ef4225 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:48.446994 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7dedbd95-d1a6-42eb-b1a8-0d0af8ef4225 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:48.468612 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8ad8c3d4-62f6-4e83-9eb4-16e6292985bd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:48.469642 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8ad8c3d4-62f6-4e83-9eb4-16e6292985bd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:48.477235 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8ad8c3d4-62f6-4e83-9eb4-16e6292985bd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:48.477687 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8ad8c3d4-62f6-4e83-9eb4-16e6292985bd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:48.478473 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8ad8c3d4-62f6-4e83-9eb4-16e6292985bd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:48.478918 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8ad8c3d4-62f6-4e83-9eb4-16e6292985bd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:48.582753 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7dedbd95-d1a6-42eb-b1a8-0d0af8ef4225 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:48.585557 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8ad8c3d4-62f6-4e83-9eb4-16e6292985bd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 31709 microversion: 2.20 time: 0.120795 Nov 23 14:34:48.587099 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 347/690] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:48 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 31709 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:34:48.591595 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7dedbd95-d1a6-42eb-b1a8-0d0af8ef4225 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1260 microversion: 2.1 time: 0.157925 Nov 23 14:34:48.592162 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 344/691] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:48 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:48.611412 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7ab81030-25bd-43e9-ba0d-99c9d1d92b1b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:48.612103 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7ab81030-25bd-43e9-ba0d-99c9d1d92b1b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:48.619412 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7ab81030-25bd-43e9-ba0d-99c9d1d92b1b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:48.619796 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7ab81030-25bd-43e9-ba0d-99c9d1d92b1b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:48.620634 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7ab81030-25bd-43e9-ba0d-99c9d1d92b1b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:48.621071 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7ab81030-25bd-43e9-ba0d-99c9d1d92b1b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:48.814751 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7ab81030-25bd-43e9-ba0d-99c9d1d92b1b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:48.822440 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7ab81030-25bd-43e9-ba0d-99c9d1d92b1b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1514 microversion: 2.1 time: 0.215089 Nov 23 14:34:48.822993 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 348/692] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:48 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1514 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:48.874154 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-fbbb4f35-fea1-4bf1-9aab-4e4b20fe0071 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:48.874682 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-fbbb4f35-fea1-4bf1-9aab-4e4b20fe0071 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:48.881131 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fbbb4f35-fea1-4bf1-9aab-4e4b20fe0071 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:48.881590 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fbbb4f35-fea1-4bf1-9aab-4e4b20fe0071 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:48.885844 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fbbb4f35-fea1-4bf1-9aab-4e4b20fe0071 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:48.885844 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fbbb4f35-fea1-4bf1-9aab-4e4b20fe0071 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:49.013844 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-fbbb4f35-fea1-4bf1-9aab-4e4b20fe0071 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:49.021975 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-fbbb4f35-fea1-4bf1-9aab-4e4b20fe0071 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1317 microversion: 2.1 time: 0.151350 Nov 23 14:34:49.022715 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 345/693] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:48 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:49.362674 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-03061d75-45bd-460c-a3e6-813628ae959f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:49.364025 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-03061d75-45bd-460c-a3e6-813628ae959f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:49.371028 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-03061d75-45bd-460c-a3e6-813628ae959f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:49.371474 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-03061d75-45bd-460c-a3e6-813628ae959f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:49.372273 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-03061d75-45bd-460c-a3e6-813628ae959f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:49.372711 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-03061d75-45bd-460c-a3e6-813628ae959f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:49.597377 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bbd6c38c-9a0d-49cf-8a94-275c4beadc65 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:49.598265 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bbd6c38c-9a0d-49cf-8a94-275c4beadc65 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:49.600389 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-03061d75-45bd-460c-a3e6-813628ae959f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 36276 microversion: 2.1 time: 0.240563 Nov 23 14:34:49.601046 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 349/694] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:49 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 36276 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:49.605422 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bbd6c38c-9a0d-49cf-8a94-275c4beadc65 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:49.605978 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bbd6c38c-9a0d-49cf-8a94-275c4beadc65 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:49.606758 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bbd6c38c-9a0d-49cf-8a94-275c4beadc65 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:49.607186 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bbd6c38c-9a0d-49cf-8a94-275c4beadc65 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:49.609339 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ec182f09-fdee-4a28-82ab-0dcf4ca54b06 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:49.610031 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ec182f09-fdee-4a28-82ab-0dcf4ca54b06 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:49.624781 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ec182f09-fdee-4a28-82ab-0dcf4ca54b06 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:49.624781 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ec182f09-fdee-4a28-82ab-0dcf4ca54b06 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:49.624781 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ec182f09-fdee-4a28-82ab-0dcf4ca54b06 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:49.624781 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ec182f09-fdee-4a28-82ab-0dcf4ca54b06 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:49.703035 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bbd6c38c-9a0d-49cf-8a94-275c4beadc65 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 32933 microversion: 2.20 time: 0.109254 Nov 23 14:34:49.707484 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 346/695] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:49 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 32933 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:34:49.818163 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ec182f09-fdee-4a28-82ab-0dcf4ca54b06 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:49.825865 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ec182f09-fdee-4a28-82ab-0dcf4ca54b06 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1260 microversion: 2.1 time: 0.220481 Nov 23 14:34:49.827404 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 350/696] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:49 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:34:49.840345 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-811d99a0-9deb-4c5b-8167-d77ef93fa06a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:49.841155 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-811d99a0-9deb-4c5b-8167-d77ef93fa06a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:49.848037 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-811d99a0-9deb-4c5b-8167-d77ef93fa06a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:49.848506 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-811d99a0-9deb-4c5b-8167-d77ef93fa06a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:49.849934 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-811d99a0-9deb-4c5b-8167-d77ef93fa06a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:49.850410 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-811d99a0-9deb-4c5b-8167-d77ef93fa06a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:49.988268 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-811d99a0-9deb-4c5b-8167-d77ef93fa06a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:49.996499 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-811d99a0-9deb-4c5b-8167-d77ef93fa06a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1514 microversion: 2.1 time: 0.160183 Nov 23 14:34:49.997275 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 347/697] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:49 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:50.039084 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-417d2116-f231-43e5-8111-9aa908459572 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:50.039822 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-417d2116-f231-43e5-8111-9aa908459572 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:50.045687 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-417d2116-f231-43e5-8111-9aa908459572 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:50.046134 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-417d2116-f231-43e5-8111-9aa908459572 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:50.046904 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-417d2116-f231-43e5-8111-9aa908459572 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:50.047324 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-417d2116-f231-43e5-8111-9aa908459572 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:50.201553 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-417d2116-f231-43e5-8111-9aa908459572 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:50.209571 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-417d2116-f231-43e5-8111-9aa908459572 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1317 microversion: 2.1 time: 0.174545 Nov 23 14:34:50.210349 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 351/698] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:50 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:50.289698 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-302ff10b-5555-4621-b160-237fc98e9fdf req-13c80210-2a77-437f-afa5-7fbdb5fd5879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66d63f1e-28e8-4644-a848-e1c1820b86f1", "name": "network-vif-deleted", "tag": "b583cf1d-49a4-4160-adc2-d5b91008581e"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:50.291243 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:34:50.291243 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:34:50.298371 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-302ff10b-5555-4621-b160-237fc98e9fdf req-13c80210-2a77-437f-afa5-7fbdb5fd5879 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:50.298801 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-302ff10b-5555-4621-b160-237fc98e9fdf req-13c80210-2a77-437f-afa5-7fbdb5fd5879 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:50.310368 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-302ff10b-5555-4621-b160-237fc98e9fdf req-13c80210-2a77-437f-afa5-7fbdb5fd5879 service nova] Creating event network-vif-deleted:b583cf1d-49a4-4160-adc2-d5b91008581e for instance 66d63f1e-28e8-4644-a848-e1c1820b86f1 on hv-cinder-80475 Nov 23 14:34:50.315308 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-302ff10b-5555-4621-b160-237fc98e9fdf req-13c80210-2a77-437f-afa5-7fbdb5fd5879 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030056 Nov 23 14:34:50.315919 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 348/699] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:34:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:34:50.513377 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-2f17b89d-7fcf-42b3-a40c-2eef88f34eaf req-51f3cfcf-5890-47ac-b51b-5f8caaec4763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "debd017d-9965-4cc4-8998-8827fb2a1072", "name": "network-vif-plugged", "status": "completed", "tag": "740e4a45-0299-43d8-aef2-b8d7f6c87383"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:50.515045 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:34:50.515045 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:34:50.523608 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-2f17b89d-7fcf-42b3-a40c-2eef88f34eaf req-51f3cfcf-5890-47ac-b51b-5f8caaec4763 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:50.524160 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-2f17b89d-7fcf-42b3-a40c-2eef88f34eaf req-51f3cfcf-5890-47ac-b51b-5f8caaec4763 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:50.534972 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-2f17b89d-7fcf-42b3-a40c-2eef88f34eaf req-51f3cfcf-5890-47ac-b51b-5f8caaec4763 service nova] Creating event network-vif-plugged:740e4a45-0299-43d8-aef2-b8d7f6c87383 for instance debd017d-9965-4cc4-8998-8827fb2a1072 on hv-cinder-80475 Nov 23 14:34:50.541252 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-2f17b89d-7fcf-42b3-a40c-2eef88f34eaf req-51f3cfcf-5890-47ac-b51b-5f8caaec4763 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032163 Nov 23 14:34:50.542040 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 352/700] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:34:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:34:50.616409 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b88f8d8b-c59e-4345-b703-92f261cfdc3b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:50.617922 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b88f8d8b-c59e-4345-b703-92f261cfdc3b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:50.624770 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b88f8d8b-c59e-4345-b703-92f261cfdc3b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:50.625212 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b88f8d8b-c59e-4345-b703-92f261cfdc3b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:50.626011 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b88f8d8b-c59e-4345-b703-92f261cfdc3b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:50.627168 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b88f8d8b-c59e-4345-b703-92f261cfdc3b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:50.711621 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b88f8d8b-c59e-4345-b703-92f261cfdc3b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 37568 microversion: 2.1 time: 0.102799 Nov 23 14:34:50.713029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 349/701] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:50 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 37568 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:50.715934 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-95223d11-fde2-4748-aa02-41ef1802a509 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:50.716947 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-95223d11-fde2-4748-aa02-41ef1802a509 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:50.722864 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-95223d11-fde2-4748-aa02-41ef1802a509 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:50.723304 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-95223d11-fde2-4748-aa02-41ef1802a509 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:50.724839 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-95223d11-fde2-4748-aa02-41ef1802a509 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:50.725381 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-95223d11-fde2-4748-aa02-41ef1802a509 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:50.813755 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-95223d11-fde2-4748-aa02-41ef1802a509 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 33567 microversion: 2.20 time: 0.101713 Nov 23 14:34:50.817660 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 353/702] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:50 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 33567 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:34:50.842503 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a6201c38-2fbd-4ea7-8229-95f513d6de77 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:50.843194 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a6201c38-2fbd-4ea7-8229-95f513d6de77 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:50.852685 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a6201c38-2fbd-4ea7-8229-95f513d6de77 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:50.853107 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a6201c38-2fbd-4ea7-8229-95f513d6de77 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:50.853986 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a6201c38-2fbd-4ea7-8229-95f513d6de77 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:50.854610 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a6201c38-2fbd-4ea7-8229-95f513d6de77 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:50.996834 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a6201c38-2fbd-4ea7-8229-95f513d6de77 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:51.004351 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a6201c38-2fbd-4ea7-8229-95f513d6de77 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1260 microversion: 2.1 time: 0.165799 Nov 23 14:34:51.022480 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 350/703] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:50 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:51.022777 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-02fee4ba-87f7-452c-a038-f6c82a0f2ab0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:51.022777 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-02fee4ba-87f7-452c-a038-f6c82a0f2ab0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:51.029019 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-02fee4ba-87f7-452c-a038-f6c82a0f2ab0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:51.029467 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-02fee4ba-87f7-452c-a038-f6c82a0f2ab0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:51.030236 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-02fee4ba-87f7-452c-a038-f6c82a0f2ab0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:51.030670 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-02fee4ba-87f7-452c-a038-f6c82a0f2ab0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:51.061321 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-02fee4ba-87f7-452c-a038-f6c82a0f2ab0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:51.061769 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-02fee4ba-87f7-452c-a038-f6c82a0f2ab0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:51.062218 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-02fee4ba-87f7-452c-a038-f6c82a0f2ab0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lazy-loading 'fault' on Instance uuid 66d63f1e-28e8-4644-a848-e1c1820b86f1 {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:34:51.101847 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-02fee4ba-87f7-452c-a038-f6c82a0f2ab0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:51.109305 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-02fee4ba-87f7-452c-a038-f6c82a0f2ab0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 200 len: 1309 microversion: 2.1 time: 0.098249 Nov 23 14:34:51.111719 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 354/704] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:51 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:51.226628 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d0123344-424f-4ade-a8ca-01f19bc8ee6e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:51.227225 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d0123344-424f-4ade-a8ca-01f19bc8ee6e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:51.233465 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d0123344-424f-4ade-a8ca-01f19bc8ee6e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:51.234115 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d0123344-424f-4ade-a8ca-01f19bc8ee6e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:51.234895 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d0123344-424f-4ade-a8ca-01f19bc8ee6e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:51.235318 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d0123344-424f-4ade-a8ca-01f19bc8ee6e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:51.385109 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d0123344-424f-4ade-a8ca-01f19bc8ee6e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:51.392410 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d0123344-424f-4ade-a8ca-01f19bc8ee6e tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1317 microversion: 2.1 time: 0.169880 Nov 23 14:34:51.393524 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 351/705] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:51 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:51.725379 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d36d6974-953a-4a35-acec-09cd48397f3a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:51.726319 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d36d6974-953a-4a35-acec-09cd48397f3a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:51.735321 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d36d6974-953a-4a35-acec-09cd48397f3a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:51.735829 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d36d6974-953a-4a35-acec-09cd48397f3a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:51.736576 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d36d6974-953a-4a35-acec-09cd48397f3a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:51.737014 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d36d6974-953a-4a35-acec-09cd48397f3a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:51.825292 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b4c12a1b-387f-4a1f-8a0b-1504751ce57f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:51.826227 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b4c12a1b-387f-4a1f-8a0b-1504751ce57f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:51.832511 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b4c12a1b-387f-4a1f-8a0b-1504751ce57f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:51.833136 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b4c12a1b-387f-4a1f-8a0b-1504751ce57f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:51.834015 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b4c12a1b-387f-4a1f-8a0b-1504751ce57f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:51.834453 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b4c12a1b-387f-4a1f-8a0b-1504751ce57f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:51.850993 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d36d6974-953a-4a35-acec-09cd48397f3a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 38119 microversion: 2.1 time: 0.129647 Nov 23 14:34:51.851934 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 355/706] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:51 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 38119 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:51.977021 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b4c12a1b-387f-4a1f-8a0b-1504751ce57f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 34622 microversion: 2.20 time: 0.155190 Nov 23 14:34:51.981220 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 352/707] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:51 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 34622 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:34:52.027970 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6f508463-55de-47ac-91c7-277c8a58017d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:52.028696 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6f508463-55de-47ac-91c7-277c8a58017d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:52.035348 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6f508463-55de-47ac-91c7-277c8a58017d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:52.035794 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6f508463-55de-47ac-91c7-277c8a58017d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:52.036674 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6f508463-55de-47ac-91c7-277c8a58017d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:52.037109 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6f508463-55de-47ac-91c7-277c8a58017d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:52.126985 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-967737f5-53b4-4e83-a23b-cf7b57691ab7 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:52.127679 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-967737f5-53b4-4e83-a23b-cf7b57691ab7 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 66d63f1e-28e8-4644-a848-e1c1820b86f1] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:52.135240 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-967737f5-53b4-4e83-a23b-cf7b57691ab7 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:52.135690 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-967737f5-53b4-4e83-a23b-cf7b57691ab7 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:52.136498 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-967737f5-53b4-4e83-a23b-cf7b57691ab7 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:52.136935 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-967737f5-53b4-4e83-a23b-cf7b57691ab7 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:52.150686 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-967737f5-53b4-4e83-a23b-cf7b57691ab7 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] HTTP exception thrown: Instance 66d63f1e-28e8-4644-a848-e1c1820b86f1 could not be found. Nov 23 14:34:52.151276 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-967737f5-53b4-4e83-a23b-cf7b57691ab7 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Returning 404 to user: Instance 66d63f1e-28e8-4644-a848-e1c1820b86f1 could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:34:52.152098 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-967737f5-53b4-4e83-a23b-cf7b57691ab7 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1" status: 404 len: 111 microversion: 2.1 time: 0.029076 Nov 23 14:34:52.152722 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 353/708] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:52 2021] GET /compute/v2.1/servers/66d63f1e-28e8-4644-a848-e1c1820b86f1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 14:34:52.171010 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6f508463-55de-47ac-91c7-277c8a58017d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:52.181246 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6f508463-55de-47ac-91c7-277c8a58017d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1260 microversion: 2.1 time: 0.157145 Nov 23 14:34:52.181803 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 356/709] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:52 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:52.410827 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f015a1a6-908b-4b12-b0af-a28b6a8e506a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:52.412752 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f015a1a6-908b-4b12-b0af-a28b6a8e506a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:52.419415 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f015a1a6-908b-4b12-b0af-a28b6a8e506a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:52.423607 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f015a1a6-908b-4b12-b0af-a28b6a8e506a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:52.423607 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f015a1a6-908b-4b12-b0af-a28b6a8e506a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:52.423607 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f015a1a6-908b-4b12-b0af-a28b6a8e506a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:52.601459 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-f015a1a6-908b-4b12-b0af-a28b6a8e506a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:52.612649 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f015a1a6-908b-4b12-b0af-a28b6a8e506a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1317 microversion: 2.1 time: 0.205341 Nov 23 14:34:52.620749 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 354/710] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:52 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:52.863535 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-bae87ba0-498a-4930-9a02-6754cc26d716 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:52.864649 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-bae87ba0-498a-4930-9a02-6754cc26d716 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:52.870839 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bae87ba0-498a-4930-9a02-6754cc26d716 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:52.871290 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bae87ba0-498a-4930-9a02-6754cc26d716 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:52.872071 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bae87ba0-498a-4930-9a02-6754cc26d716 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:52.872527 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bae87ba0-498a-4930-9a02-6754cc26d716 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:52.943584 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-bae87ba0-498a-4930-9a02-6754cc26d716 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 38119 microversion: 2.1 time: 0.083718 Nov 23 14:34:52.944576 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 357/711] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:52 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 38119 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:52.989341 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-15fa9252-c365-47b0-95a5-c65df2f4d2b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:52.990295 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-15fa9252-c365-47b0-95a5-c65df2f4d2b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:52.996797 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-15fa9252-c365-47b0-95a5-c65df2f4d2b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:53.017978 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-15fa9252-c365-47b0-95a5-c65df2f4d2b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:53.017978 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-15fa9252-c365-47b0-95a5-c65df2f4d2b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:53.017978 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-15fa9252-c365-47b0-95a5-c65df2f4d2b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:53.082250 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-15fa9252-c365-47b0-95a5-c65df2f4d2b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 35430 microversion: 2.20 time: 0.096909 Nov 23 14:34:53.082898 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 355/712] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:52 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 35430 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:53.198755 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ce0c1675-55b6-4790-bdd6-eabce7a600cc tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:53.199659 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ce0c1675-55b6-4790-bdd6-eabce7a600cc tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:53.205748 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ce0c1675-55b6-4790-bdd6-eabce7a600cc tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:53.208401 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ce0c1675-55b6-4790-bdd6-eabce7a600cc tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:53.208401 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ce0c1675-55b6-4790-bdd6-eabce7a600cc tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:53.208401 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ce0c1675-55b6-4790-bdd6-eabce7a600cc tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:53.341104 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ce0c1675-55b6-4790-bdd6-eabce7a600cc tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:53.349650 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ce0c1675-55b6-4790-bdd6-eabce7a600cc tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1260 microversion: 2.1 time: 0.154774 Nov 23 14:34:53.350216 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 358/713] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:53 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:53.631175 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-13e444a6-f6ad-4710-a4c3-6cf0e0014060 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:53.632042 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-13e444a6-f6ad-4710-a4c3-6cf0e0014060 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:53.640200 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-13e444a6-f6ad-4710-a4c3-6cf0e0014060 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:53.640790 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-13e444a6-f6ad-4710-a4c3-6cf0e0014060 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:53.641774 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-13e444a6-f6ad-4710-a4c3-6cf0e0014060 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:53.642222 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-13e444a6-f6ad-4710-a4c3-6cf0e0014060 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:53.818033 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-13e444a6-f6ad-4710-a4c3-6cf0e0014060 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:53.825234 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-13e444a6-f6ad-4710-a4c3-6cf0e0014060 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1506 microversion: 2.1 time: 0.198225 Nov 23 14:34:53.831509 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 356/714] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:53 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:53.955765 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-fc32bb43-a63a-45c3-b6ea-90d1e22dd82d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:53.956785 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-fc32bb43-a63a-45c3-b6ea-90d1e22dd82d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:53.963713 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc32bb43-a63a-45c3-b6ea-90d1e22dd82d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:53.964459 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc32bb43-a63a-45c3-b6ea-90d1e22dd82d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:53.965236 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc32bb43-a63a-45c3-b6ea-90d1e22dd82d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:53.965662 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc32bb43-a63a-45c3-b6ea-90d1e22dd82d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:54.094587 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1050fce0-fc12-4b8e-b2ac-faf5617fc8da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:54.095332 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1050fce0-fc12-4b8e-b2ac-faf5617fc8da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:54.102174 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1050fce0-fc12-4b8e-b2ac-faf5617fc8da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:54.102618 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1050fce0-fc12-4b8e-b2ac-faf5617fc8da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:54.103400 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1050fce0-fc12-4b8e-b2ac-faf5617fc8da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:54.103830 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1050fce0-fc12-4b8e-b2ac-faf5617fc8da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:57.026883 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-fc32bb43-a63a-45c3-b6ea-90d1e22dd82d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 38119 microversion: 2.1 time: 3.074423 Nov 23 14:34:57.031411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 359/715] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:53 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 38119 bytes in 3076 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:57.032576 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ecf2ac1e-6865-450c-bad9-0a083ee10fc2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:57.033267 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ecf2ac1e-6865-450c-bad9-0a083ee10fc2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:57.040788 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ecf2ac1e-6865-450c-bad9-0a083ee10fc2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:57.041239 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ecf2ac1e-6865-450c-bad9-0a083ee10fc2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:57.042016 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ecf2ac1e-6865-450c-bad9-0a083ee10fc2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:57.042452 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ecf2ac1e-6865-450c-bad9-0a083ee10fc2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:57.065010 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1050fce0-fc12-4b8e-b2ac-faf5617fc8da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 38136 microversion: 2.20 time: 2.974236 Nov 23 14:34:57.069652 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 357/716] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:54 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 38136 bytes in 2976 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:34:57.177297 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ecf2ac1e-6865-450c-bad9-0a083ee10fc2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:57.184570 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ecf2ac1e-6865-450c-bad9-0a083ee10fc2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1260 microversion: 2.1 time: 0.155906 Nov 23 14:34:57.185123 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 360/717] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:57 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:58.040328 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-79a84196-2d81-488f-bf8c-cbb4c459edbe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:58.041318 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-79a84196-2d81-488f-bf8c-cbb4c459edbe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:58.048072 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-79a84196-2d81-488f-bf8c-cbb4c459edbe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:58.048546 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-79a84196-2d81-488f-bf8c-cbb4c459edbe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:58.049315 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-79a84196-2d81-488f-bf8c-cbb4c459edbe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:58.049743 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-79a84196-2d81-488f-bf8c-cbb4c459edbe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:58.077108 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-177040d2-bfdf-4b5b-8a07-be7b935feafc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:58.078296 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-177040d2-bfdf-4b5b-8a07-be7b935feafc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:58.085824 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-177040d2-bfdf-4b5b-8a07-be7b935feafc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:58.086274 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-177040d2-bfdf-4b5b-8a07-be7b935feafc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:58.087077 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-177040d2-bfdf-4b5b-8a07-be7b935feafc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:58.087509 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-177040d2-bfdf-4b5b-8a07-be7b935feafc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:58.127271 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-79a84196-2d81-488f-bf8c-cbb4c459edbe tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 38119 microversion: 2.1 time: 0.091906 Nov 23 14:34:58.127923 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 358/718] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:58 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 38119 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:34:58.178445 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-177040d2-bfdf-4b5b-8a07-be7b935feafc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 38206 microversion: 2.20 time: 0.104748 Nov 23 14:34:58.179313 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 361/719] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:58 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 38206 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:34:58.202188 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-98e41679-73ba-4c54-88e3-1c9097642002 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:58.202874 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-98e41679-73ba-4c54-88e3-1c9097642002 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:58.210194 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-98e41679-73ba-4c54-88e3-1c9097642002 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:58.210644 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-98e41679-73ba-4c54-88e3-1c9097642002 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:58.211414 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-98e41679-73ba-4c54-88e3-1c9097642002 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:58.211855 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-98e41679-73ba-4c54-88e3-1c9097642002 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:58.347925 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-98e41679-73ba-4c54-88e3-1c9097642002 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:58.356382 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-98e41679-73ba-4c54-88e3-1c9097642002 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1260 microversion: 2.1 time: 0.158128 Nov 23 14:34:58.356961 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 359/720] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:58 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:34:58.518739 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-37088c6f-f2f0-4421-a9da-d7021ce25f9d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4dd007f-c323-441b-9328-a93eb3d3c23d"}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:58.523296 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-37088c6f-f2f0-4421-a9da-d7021ce25f9d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:58.530503 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-37088c6f-f2f0-4421-a9da-d7021ce25f9d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:58.531214 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-37088c6f-f2f0-4421-a9da-d7021ce25f9d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:58.532310 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-37088c6f-f2f0-4421-a9da-d7021ce25f9d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:58.534777 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-37088c6f-f2f0-4421-a9da-d7021ce25f9d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:59.139417 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-8c6b8fe8-5305-46b6-9aea-8f6d5aa76d58 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:59.140484 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-8c6b8fe8-5305-46b6-9aea-8f6d5aa76d58 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:59.148321 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8c6b8fe8-5305-46b6-9aea-8f6d5aa76d58 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:59.148775 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8c6b8fe8-5305-46b6-9aea-8f6d5aa76d58 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:59.149565 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8c6b8fe8-5305-46b6-9aea-8f6d5aa76d58 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:59.150004 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8c6b8fe8-5305-46b6-9aea-8f6d5aa76d58 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:59.232504 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-37088c6f-f2f0-4421-a9da-d7021ce25f9d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "POST /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.718653 Nov 23 14:34:59.233140 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 362/721] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Nov 23 14:34:58 2021] POST /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments => generated 194 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:34:59.238307 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-bb7658bd-bec8-4c64-acff-81c64b8bcd53 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:34:59.239393 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-bb7658bd-bec8-4c64-acff-81c64b8bcd53 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:59.246019 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bb7658bd-bec8-4c64-acff-81c64b8bcd53 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:59.246644 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bb7658bd-bec8-4c64-acff-81c64b8bcd53 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:59.247432 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bb7658bd-bec8-4c64-acff-81c64b8bcd53 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:59.248031 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bb7658bd-bec8-4c64-acff-81c64b8bcd53 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:59.255257 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-8c6b8fe8-5305-46b6-9aea-8f6d5aa76d58 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 200 len: 38250 microversion: 2.1 time: 0.118951 Nov 23 14:34:59.263984 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 360/722] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:34:59 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 38250 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:34:59.271130 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-792043df-8da6-48e6-a6c7-3af28f90e600 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:59.271806 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-792043df-8da6-48e6-a6c7-3af28f90e600 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:59.278455 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-792043df-8da6-48e6-a6c7-3af28f90e600 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:59.278887 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-792043df-8da6-48e6-a6c7-3af28f90e600 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:59.279901 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-792043df-8da6-48e6-a6c7-3af28f90e600 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:59.280529 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-792043df-8da6-48e6-a6c7-3af28f90e600 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:59.307939 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-792043df-8da6-48e6-a6c7-3af28f90e600 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/ips" status: 200 len: 145 microversion: 2.1 time: 0.042049 Nov 23 14:34:59.308557 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 361/723] 10.222.0.82 () {58 vars in 1247 bytes} [Tue Nov 23 14:34:59 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:34:59.332204 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-bb7658bd-bec8-4c64-acff-81c64b8bcd53 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 38206 microversion: 2.20 time: 0.097693 Nov 23 14:34:59.332935 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 363/724] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:34:59 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 38206 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:34:59.373852 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f884ca9b-82e4-4261-858f-7ffdcd4b3ea7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:34:59.374461 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f884ca9b-82e4-4261-858f-7ffdcd4b3ea7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:34:59.381299 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f884ca9b-82e4-4261-858f-7ffdcd4b3ea7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:59.381838 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f884ca9b-82e4-4261-858f-7ffdcd4b3ea7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:59.382904 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f884ca9b-82e4-4261-858f-7ffdcd4b3ea7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:34:59.383173 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f884ca9b-82e4-4261-858f-7ffdcd4b3ea7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:34:59.519718 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-f884ca9b-82e4-4261-858f-7ffdcd4b3ea7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:34:59.528077 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f884ca9b-82e4-4261-858f-7ffdcd4b3ea7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1260 microversion: 2.1 time: 0.158054 Nov 23 14:34:59.528711 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 362/725] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:34:59 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:00.343905 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9b259142-f924-478c-9f10-f2db057772a7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:00.344946 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9b259142-f924-478c-9f10-f2db057772a7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:00.352291 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9b259142-f924-478c-9f10-f2db057772a7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:00.352738 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9b259142-f924-478c-9f10-f2db057772a7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:00.353552 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9b259142-f924-478c-9f10-f2db057772a7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:00.353991 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9b259142-f924-478c-9f10-f2db057772a7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:00.483113 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9b259142-f924-478c-9f10-f2db057772a7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 200 len: 38349 microversion: 2.20 time: 0.143135 Nov 23 14:35:00.483843 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 364/726] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:35:00 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 38349 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:35:00.499457 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-fca3cdcf-401a-4200-bcf1-d88180771fa0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:00.500013 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-fca3cdcf-401a-4200-bcf1-d88180771fa0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:00.509071 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fca3cdcf-401a-4200-bcf1-d88180771fa0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:00.509613 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fca3cdcf-401a-4200-bcf1-d88180771fa0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:00.510497 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fca3cdcf-401a-4200-bcf1-d88180771fa0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:00.510974 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fca3cdcf-401a-4200-bcf1-d88180771fa0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:00.533371 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-fca3cdcf-401a-4200-bcf1-d88180771fa0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/ips" status: 200 len: 151 microversion: 2.20 time: 0.039023 Nov 23 14:35:00.533969 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 363/727] 10.222.0.82 () {60 vars in 1288 bytes} [Tue Nov 23 14:35:00 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:35:00.545796 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d1c8eb58-4b91-4d06-8933-092c635362c8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:00.546492 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d1c8eb58-4b91-4d06-8933-092c635362c8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:00.553905 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d1c8eb58-4b91-4d06-8933-092c635362c8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:00.555836 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d1c8eb58-4b91-4d06-8933-092c635362c8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:00.555836 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d1c8eb58-4b91-4d06-8933-092c635362c8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:00.555836 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d1c8eb58-4b91-4d06-8933-092c635362c8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:00.691576 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d1c8eb58-4b91-4d06-8933-092c635362c8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:00.699330 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d1c8eb58-4b91-4d06-8933-092c635362c8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1260 microversion: 2.1 time: 0.157566 Nov 23 14:35:00.699890 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 365/728] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:00 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:01.715787 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-80f8fadd-4c5c-487f-9acc-7b134856b65e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:01.716505 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-80f8fadd-4c5c-487f-9acc-7b134856b65e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:01.722632 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-80f8fadd-4c5c-487f-9acc-7b134856b65e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:01.723192 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-80f8fadd-4c5c-487f-9acc-7b134856b65e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:01.724354 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-80f8fadd-4c5c-487f-9acc-7b134856b65e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:01.724796 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-80f8fadd-4c5c-487f-9acc-7b134856b65e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:01.863057 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-80f8fadd-4c5c-487f-9acc-7b134856b65e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:01.870416 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-80f8fadd-4c5c-487f-9acc-7b134856b65e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1260 microversion: 2.1 time: 0.158186 Nov 23 14:35:01.870983 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 364/729] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:01 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:02.765639 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-58b78db6-e86a-4783-8abb-5993b9153364 req-73aa17dc-4420-4e2d-941f-e4c3c74f5604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d82b41-cf80-4881-975e-eb1d71b0efc7", "name": "network-vif-plugged", "status": "completed", "tag": "20c986d1-94ea-44c7-9233-9b2ae752b164"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:02.767837 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:35:02.767837 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:35:02.775139 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-58b78db6-e86a-4783-8abb-5993b9153364 req-73aa17dc-4420-4e2d-941f-e4c3c74f5604 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:02.775660 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-58b78db6-e86a-4783-8abb-5993b9153364 req-73aa17dc-4420-4e2d-941f-e4c3c74f5604 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:02.786891 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-58b78db6-e86a-4783-8abb-5993b9153364 req-73aa17dc-4420-4e2d-941f-e4c3c74f5604 service nova] Creating event network-vif-plugged:20c986d1-94ea-44c7-9233-9b2ae752b164 for instance 09d82b41-cf80-4881-975e-eb1d71b0efc7 on hv-cinder-80475 Nov 23 14:35:02.791687 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-58b78db6-e86a-4783-8abb-5993b9153364 req-73aa17dc-4420-4e2d-941f-e4c3c74f5604 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029992 Nov 23 14:35:02.792295 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 366/730] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:35:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:02.887577 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-57faa72b-eb95-42f4-b32e-0398f6997244 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:02.888368 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-57faa72b-eb95-42f4-b32e-0398f6997244 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:02.894708 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-57faa72b-eb95-42f4-b32e-0398f6997244 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:02.895284 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-57faa72b-eb95-42f4-b32e-0398f6997244 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:02.896066 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-57faa72b-eb95-42f4-b32e-0398f6997244 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:02.896517 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-57faa72b-eb95-42f4-b32e-0398f6997244 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:03.070018 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-57faa72b-eb95-42f4-b32e-0398f6997244 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:03.071402 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-57faa72b-eb95-42f4-b32e-0398f6997244 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1260 microversion: 2.1 time: 0.188312 Nov 23 14:35:03.071974 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 365/731] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:02 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:04.089065 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7a7a6b4d-8c37-45b5-aa42-e07707f89878 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:04.089765 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7a7a6b4d-8c37-45b5-aa42-e07707f89878 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:04.096155 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a7a6b4d-8c37-45b5-aa42-e07707f89878 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:04.096656 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a7a6b4d-8c37-45b5-aa42-e07707f89878 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:04.097489 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a7a6b4d-8c37-45b5-aa42-e07707f89878 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:04.097925 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a7a6b4d-8c37-45b5-aa42-e07707f89878 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:04.233081 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7a7a6b4d-8c37-45b5-aa42-e07707f89878 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:04.241682 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7a7a6b4d-8c37-45b5-aa42-e07707f89878 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1260 microversion: 2.1 time: 0.156452 Nov 23 14:35:04.242257 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 367/732] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:04 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:05.259082 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-49494882-172e-47fd-89aa-64016ee5ca3a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:05.259082 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-49494882-172e-47fd-89aa-64016ee5ca3a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:05.263940 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-49494882-172e-47fd-89aa-64016ee5ca3a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:05.264412 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-49494882-172e-47fd-89aa-64016ee5ca3a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:05.265180 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-49494882-172e-47fd-89aa-64016ee5ca3a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:05.265609 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-49494882-172e-47fd-89aa-64016ee5ca3a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:05.400709 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-49494882-172e-47fd-89aa-64016ee5ca3a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:05.408829 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-49494882-172e-47fd-89aa-64016ee5ca3a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1260 microversion: 2.1 time: 0.155117 Nov 23 14:35:05.411026 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 366/733] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:05 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:05.737623 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-67143c80-30d3-4384-8417-203112cbc34e tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-333037034", "imageRef": "b06b9241-c147-436d-86bb-7c49ad8ef09c", "flavorRef": "452", "networks": [{"uuid": "a238991b-9612-42e1-988f-c440e19d18f2"}]}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:05.789694 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.network.neutron [None req-67143c80-30d3-4384-8417-203112cbc34e tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] validate_networks() for [('a238991b-9612-42e1-988f-c440e19d18f2', None, None, None, None, None)] {{(pid=116787) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:35:06.357019 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-67143c80-30d3-4384-8417-203112cbc34e tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Flavor limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:35:06.357435 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-67143c80-30d3-4384-8417-203112cbc34e tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Image limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:35:06.357933 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-67143c80-30d3-4384-8417-203112cbc34e tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Flavor pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:35:06.358359 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-67143c80-30d3-4384-8417-203112cbc34e tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Image pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:35:06.358761 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-67143c80-30d3-4384-8417-203112cbc34e tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:35:06.371729 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-67143c80-30d3-4384-8417-203112cbc34e tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:06.372265 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-67143c80-30d3-4384-8417-203112cbc34e tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:06.377578 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-67143c80-30d3-4384-8417-203112cbc34e tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:06.377578 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-67143c80-30d3-4384-8417-203112cbc34e tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:06.389444 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-67143c80-30d3-4384-8417-203112cbc34e tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Getting quotas for project 374651ab7b774bf6b1d6c8ac7a94bdb8. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:35:06.393316 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-67143c80-30d3-4384-8417-203112cbc34e tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Getting quotas for user 1ab6b03dcab74efd8ed186b0330a5555 and project 374651ab7b774bf6b1d6c8ac7a94bdb8. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:35:06.405019 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-67143c80-30d3-4384-8417-203112cbc34e tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Going to run 1 instances... {{(pid=116787) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:35:06.407348 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-67143c80-30d3-4384-8417-203112cbc34e tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b06b9241-c147-436d-86bb-7c49ad8ef09c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:35:06.426760 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-8683b696-8cef-4017-be12-49a6635c1f0d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:06.427563 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-8683b696-8cef-4017-be12-49a6635c1f0d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:06.434645 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8683b696-8cef-4017-be12-49a6635c1f0d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:06.435107 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8683b696-8cef-4017-be12-49a6635c1f0d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:06.435979 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8683b696-8cef-4017-be12-49a6635c1f0d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:06.436459 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8683b696-8cef-4017-be12-49a6635c1f0d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:06.563771 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-67143c80-30d3-4384-8417-203112cbc34e tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829771 Nov 23 14:35:06.564991 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 368/734] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:35:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 14:35:06.582565 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0098b456-9818-439b-a810-246c1fa06976 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:06.593539 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0098b456-9818-439b-a810-246c1fa06976 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:06.594154 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-8683b696-8cef-4017-be12-49a6635c1f0d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:06.601703 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-8683b696-8cef-4017-be12-49a6635c1f0d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1260 microversion: 2.1 time: 0.178457 Nov 23 14:35:06.603268 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 367/735] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:06 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:06.647894 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0098b456-9818-439b-a810-246c1fa06976 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:06.657428 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0098b456-9818-439b-a810-246c1fa06976 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1218 microversion: 2.1 time: 0.085623 Nov 23 14:35:06.658005 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 369/736] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:06 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:07.462961 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9587abfa-4fc3-4c6f-b2e5-bf5f975464c8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:07.463509 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9587abfa-4fc3-4c6f-b2e5-bf5f975464c8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:07.469891 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9587abfa-4fc3-4c6f-b2e5-bf5f975464c8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:07.470331 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9587abfa-4fc3-4c6f-b2e5-bf5f975464c8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:07.471095 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9587abfa-4fc3-4c6f-b2e5-bf5f975464c8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:07.471523 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9587abfa-4fc3-4c6f-b2e5-bf5f975464c8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:07.495199 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.objects.instance [None req-9587abfa-4fc3-4c6f-b2e5-bf5f975464c8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lazy-loading 'flavor' on Instance uuid f5c8dbd0-2f80-4158-923b-24f263fd9832 {{(pid=116788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:35:07.619089 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f39e9ddf-4e50-44e9-9ce6-b013b3d1aa18 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:07.619691 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f39e9ddf-4e50-44e9-9ce6-b013b3d1aa18 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:07.626104 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f39e9ddf-4e50-44e9-9ce6-b013b3d1aa18 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:07.626545 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f39e9ddf-4e50-44e9-9ce6-b013b3d1aa18 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:07.627320 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f39e9ddf-4e50-44e9-9ce6-b013b3d1aa18 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:07.627746 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f39e9ddf-4e50-44e9-9ce6-b013b3d1aa18 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:07.766249 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f39e9ddf-4e50-44e9-9ce6-b013b3d1aa18 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:07.775161 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f39e9ddf-4e50-44e9-9ce6-b013b3d1aa18 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1444 microversion: 2.1 time: 0.159653 Nov 23 14:35:07.775575 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 370/737] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:07 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:07.779799 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-47e91fe4-744e-4091-8668-e0c0ea466a3b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:07.780438 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-47e91fe4-744e-4091-8668-e0c0ea466a3b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:07.787422 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-47e91fe4-744e-4091-8668-e0c0ea466a3b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:07.787883 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-47e91fe4-744e-4091-8668-e0c0ea466a3b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:07.788696 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-47e91fe4-744e-4091-8668-e0c0ea466a3b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:07.789136 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-47e91fe4-744e-4091-8668-e0c0ea466a3b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:07.858387 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-47e91fe4-744e-4091-8668-e0c0ea466a3b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:07.870028 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-47e91fe4-744e-4091-8668-e0c0ea466a3b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1222 microversion: 2.1 time: 0.091821 Nov 23 14:35:07.871150 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 371/738] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:07 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:07.875922 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-cdbdc7e7-b8dc-4a68-9e54-9fe441934230 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49e2dcf8-5dda-40a6-8ab9-5a51b381c1d3"}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:07.877322 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-cdbdc7e7-b8dc-4a68-9e54-9fe441934230 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:07.885882 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cdbdc7e7-b8dc-4a68-9e54-9fe441934230 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:07.886694 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cdbdc7e7-b8dc-4a68-9e54-9fe441934230 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:07.887772 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cdbdc7e7-b8dc-4a68-9e54-9fe441934230 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:07.888345 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cdbdc7e7-b8dc-4a68-9e54-9fe441934230 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:08.083610 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9587abfa-4fc3-4c6f-b2e5-bf5f975464c8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 202 len: 0 microversion: 2.20 time: 0.624401 Nov 23 14:35:08.084330 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 368/739] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:35:07 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 14:35:08.091585 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-dcbf020b-50c8-45e4-ad44-1588a9cf0959 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:08.092296 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-dcbf020b-50c8-45e4-ad44-1588a9cf0959 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:08.099683 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dcbf020b-50c8-45e4-ad44-1588a9cf0959 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:08.100140 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dcbf020b-50c8-45e4-ad44-1588a9cf0959 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:08.101199 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dcbf020b-50c8-45e4-ad44-1588a9cf0959 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:08.101657 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dcbf020b-50c8-45e4-ad44-1588a9cf0959 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:08.236629 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-dcbf020b-50c8-45e4-ad44-1588a9cf0959 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:08.244830 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-dcbf020b-50c8-45e4-ad44-1588a9cf0959 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1444 microversion: 2.1 time: 0.157245 Nov 23 14:35:08.245769 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 369/740] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:08 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:08.253289 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-548b75a6-c470-4ee8-af09-5a3ea29731a8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:08.253886 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-548b75a6-c470-4ee8-af09-5a3ea29731a8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:08.260178 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-548b75a6-c470-4ee8-af09-5a3ea29731a8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:08.260890 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-548b75a6-c470-4ee8-af09-5a3ea29731a8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:08.262037 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-548b75a6-c470-4ee8-af09-5a3ea29731a8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:08.262941 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-548b75a6-c470-4ee8-af09-5a3ea29731a8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:08.569861 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.objects.instance [None req-548b75a6-c470-4ee8-af09-5a3ea29731a8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lazy-loading 'services' on Instance uuid debd017d-9965-4cc4-8998-8827fb2a1072 {{(pid=116788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:35:08.700764 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-cdbdc7e7-b8dc-4a68-9e54-9fe441934230 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.828161 Nov 23 14:35:08.705443 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 372/741] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Nov 23 14:35:07 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/os-volume_attachments => generated 194 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:08.707713 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c9875f07-868e-46be-b2ba-52fa83873132 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:08.708658 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c9875f07-868e-46be-b2ba-52fa83873132 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:08.720492 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c9875f07-868e-46be-b2ba-52fa83873132 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:08.722175 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c9875f07-868e-46be-b2ba-52fa83873132 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:08.723921 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c9875f07-868e-46be-b2ba-52fa83873132 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:08.724606 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c9875f07-868e-46be-b2ba-52fa83873132 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:08.822244 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-548b75a6-c470-4ee8-af09-5a3ea29731a8 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "DELETE /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments/a4dd007f-c323-441b-9328-a93eb3d3c23d" status: 202 len: 0 microversion: 2.1 time: 0.574949 Nov 23 14:35:08.825564 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 370/742] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Nov 23 14:35:08 2021] DELETE /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments/a4dd007f-c323-441b-9328-a93eb3d3c23d => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:35:08.833667 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d59a09d7-4be1-41d1-b24c-1014d8da7cdd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:08.835436 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d59a09d7-4be1-41d1-b24c-1014d8da7cdd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:08.843842 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d59a09d7-4be1-41d1-b24c-1014d8da7cdd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:08.844605 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d59a09d7-4be1-41d1-b24c-1014d8da7cdd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:08.846951 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d59a09d7-4be1-41d1-b24c-1014d8da7cdd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:08.847897 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d59a09d7-4be1-41d1-b24c-1014d8da7cdd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:08.890231 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d59a09d7-4be1-41d1-b24c-1014d8da7cdd tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061204 Nov 23 14:35:08.891154 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 371/743] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:35:08 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:35:08.896105 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d3dcb927-f4e4-45d1-8aba-a35acc48885c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:08.896926 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d3dcb927-f4e4-45d1-8aba-a35acc48885c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:08.903556 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d3dcb927-f4e4-45d1-8aba-a35acc48885c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:08.904285 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d3dcb927-f4e4-45d1-8aba-a35acc48885c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:08.905269 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d3dcb927-f4e4-45d1-8aba-a35acc48885c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:08.905851 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d3dcb927-f4e4-45d1-8aba-a35acc48885c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:08.997733 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d3dcb927-f4e4-45d1-8aba-a35acc48885c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:09.005472 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d3dcb927-f4e4-45d1-8aba-a35acc48885c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1278 microversion: 2.1 time: 0.113036 Nov 23 14:35:09.006624 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 372/744] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:08 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1278 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:09.086046 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c9875f07-868e-46be-b2ba-52fa83873132 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:09.097649 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c9875f07-868e-46be-b2ba-52fa83873132 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:09.099257 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c9875f07-868e-46be-b2ba-52fa83873132 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:09.100607 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c9875f07-868e-46be-b2ba-52fa83873132 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.397244 Nov 23 14:35:09.101173 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 373/745] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:08 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:09.902767 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d332895a-e3f9-43e1-8bbb-620ae1f441a2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:09.903789 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d332895a-e3f9-43e1-8bbb-620ae1f441a2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:09.911232 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d332895a-e3f9-43e1-8bbb-620ae1f441a2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:09.911682 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d332895a-e3f9-43e1-8bbb-620ae1f441a2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:09.912492 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d332895a-e3f9-43e1-8bbb-620ae1f441a2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:09.913092 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d332895a-e3f9-43e1-8bbb-620ae1f441a2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:09.944359 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d332895a-e3f9-43e1-8bbb-620ae1f441a2 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046160 Nov 23 14:35:09.945131 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 373/746] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:35:09 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:10.023823 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-db03b0ac-dda6-463c-9018-cf8b7e9a0fa8 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:10.025347 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-db03b0ac-dda6-463c-9018-cf8b7e9a0fa8 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:10.032926 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-db03b0ac-dda6-463c-9018-cf8b7e9a0fa8 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:10.034367 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-db03b0ac-dda6-463c-9018-cf8b7e9a0fa8 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:10.036414 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-db03b0ac-dda6-463c-9018-cf8b7e9a0fa8 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:10.037005 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-db03b0ac-dda6-463c-9018-cf8b7e9a0fa8 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:10.118544 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c7f15660-7b08-4cb5-8b09-73ac9a73e921 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:10.119145 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c7f15660-7b08-4cb5-8b09-73ac9a73e921 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:10.125639 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c7f15660-7b08-4cb5-8b09-73ac9a73e921 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:10.126163 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c7f15660-7b08-4cb5-8b09-73ac9a73e921 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:10.127504 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c7f15660-7b08-4cb5-8b09-73ac9a73e921 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:10.128467 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c7f15660-7b08-4cb5-8b09-73ac9a73e921 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:10.275372 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c7f15660-7b08-4cb5-8b09-73ac9a73e921 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:10.283724 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c7f15660-7b08-4cb5-8b09-73ac9a73e921 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:10.287884 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c7f15660-7b08-4cb5-8b09-73ac9a73e921 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:10.287884 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c7f15660-7b08-4cb5-8b09-73ac9a73e921 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.171961 Nov 23 14:35:10.287884 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 374/747] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:10 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:35:10.321356 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-db03b0ac-dda6-463c-9018-cf8b7e9a0fa8 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:10.328913 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-db03b0ac-dda6-463c-9018-cf8b7e9a0fa8 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1318 microversion: 2.1 time: 0.308772 Nov 23 14:35:10.329607 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 374/748] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:10 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:10.956951 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-05768172-0e90-49ca-9fe1-c723a4bfe829 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:10.957872 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-05768172-0e90-49ca-9fe1-c723a4bfe829 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:10.964137 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-05768172-0e90-49ca-9fe1-c723a4bfe829 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:10.966574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-05768172-0e90-49ca-9fe1-c723a4bfe829 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:10.966574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-05768172-0e90-49ca-9fe1-c723a4bfe829 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:10.966574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-05768172-0e90-49ca-9fe1-c723a4bfe829 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:10.996377 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-05768172-0e90-49ca-9fe1-c723a4bfe829 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044195 Nov 23 14:35:10.997868 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 375/749] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:35:10 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:11.305646 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-285fddf3-d8a0-4519-817d-c2b11857eea2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:11.306242 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-285fddf3-d8a0-4519-817d-c2b11857eea2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:11.313731 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-285fddf3-d8a0-4519-817d-c2b11857eea2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:11.323191 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-285fddf3-d8a0-4519-817d-c2b11857eea2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:11.323191 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-285fddf3-d8a0-4519-817d-c2b11857eea2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:11.323191 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-285fddf3-d8a0-4519-817d-c2b11857eea2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:11.346737 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-843e4068-8d83-4d8e-9b49-dae4d1daed41 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:11.347662 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-843e4068-8d83-4d8e-9b49-dae4d1daed41 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:11.356918 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-843e4068-8d83-4d8e-9b49-dae4d1daed41 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:11.358316 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-843e4068-8d83-4d8e-9b49-dae4d1daed41 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:11.359131 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-843e4068-8d83-4d8e-9b49-dae4d1daed41 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:11.359614 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-843e4068-8d83-4d8e-9b49-dae4d1daed41 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:11.542925 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-843e4068-8d83-4d8e-9b49-dae4d1daed41 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:11.551177 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-843e4068-8d83-4d8e-9b49-dae4d1daed41 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1318 microversion: 2.1 time: 0.208284 Nov 23 14:35:11.552041 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 376/750] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:11 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:11.640556 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-285fddf3-d8a0-4519-817d-c2b11857eea2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:11.649214 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-285fddf3-d8a0-4519-817d-c2b11857eea2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:11.650718 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-285fddf3-d8a0-4519-817d-c2b11857eea2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:11.651872 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-285fddf3-d8a0-4519-817d-c2b11857eea2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.350281 Nov 23 14:35:11.652462 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 375/751] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:11 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:11.703170 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-f4051132-2f0f-4a1a-82b0-06521bdbeef5 req-818f0cff-2388-4c22-bf47-e94f724561e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d82b41-cf80-4881-975e-eb1d71b0efc7", "tag": "20c986d1-94ea-44c7-9233-9b2ae752b164"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:11.706767 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:35:11.706767 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:35:11.714314 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-f4051132-2f0f-4a1a-82b0-06521bdbeef5 req-818f0cff-2388-4c22-bf47-e94f724561e3 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:11.714839 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-f4051132-2f0f-4a1a-82b0-06521bdbeef5 req-818f0cff-2388-4c22-bf47-e94f724561e3 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:11.726995 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-f4051132-2f0f-4a1a-82b0-06521bdbeef5 req-818f0cff-2388-4c22-bf47-e94f724561e3 service nova] Creating event network-changed:20c986d1-94ea-44c7-9233-9b2ae752b164 for instance 09d82b41-cf80-4881-975e-eb1d71b0efc7 on hv-cinder-80475 Nov 23 14:35:11.732682 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-f4051132-2f0f-4a1a-82b0-06521bdbeef5 req-818f0cff-2388-4c22-bf47-e94f724561e3 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034519 Nov 23 14:35:11.734210 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 377/752] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:35:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:12.010540 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-95fabad1-1b39-4978-9bf0-a6ca1c3b50e3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:12.011574 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-95fabad1-1b39-4978-9bf0-a6ca1c3b50e3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:12.018008 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-95fabad1-1b39-4978-9bf0-a6ca1c3b50e3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:12.018464 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-95fabad1-1b39-4978-9bf0-a6ca1c3b50e3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:12.020530 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-95fabad1-1b39-4978-9bf0-a6ca1c3b50e3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:12.020616 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-95fabad1-1b39-4978-9bf0-a6ca1c3b50e3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:12.057385 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-95fabad1-1b39-4978-9bf0-a6ca1c3b50e3 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051514 Nov 23 14:35:12.061646 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 376/753] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:35:12 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:12.570197 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-cde4985d-2d91-4c85-a6c6-748b3fc43294 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:12.571443 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-cde4985d-2d91-4c85-a6c6-748b3fc43294 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:12.577687 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cde4985d-2d91-4c85-a6c6-748b3fc43294 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:12.578062 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cde4985d-2d91-4c85-a6c6-748b3fc43294 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:12.578820 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cde4985d-2d91-4c85-a6c6-748b3fc43294 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:12.579245 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cde4985d-2d91-4c85-a6c6-748b3fc43294 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:12.670286 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8a07e847-f060-4dbb-846a-f052e5a6bf28 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:12.671438 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8a07e847-f060-4dbb-846a-f052e5a6bf28 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:12.678774 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8a07e847-f060-4dbb-846a-f052e5a6bf28 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:12.679515 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8a07e847-f060-4dbb-846a-f052e5a6bf28 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:12.680515 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8a07e847-f060-4dbb-846a-f052e5a6bf28 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:12.681134 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8a07e847-f060-4dbb-846a-f052e5a6bf28 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:12.730737 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-cde4985d-2d91-4c85-a6c6-748b3fc43294 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:12.739388 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-cde4985d-2d91-4c85-a6c6-748b3fc43294 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1318 microversion: 2.1 time: 0.173603 Nov 23 14:35:12.740356 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 378/754] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:12 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:12.835148 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-8a07e847-f060-4dbb-846a-f052e5a6bf28 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:12.843197 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-8a07e847-f060-4dbb-846a-f052e5a6bf28 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:12.844960 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-8a07e847-f060-4dbb-846a-f052e5a6bf28 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:12.848365 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8a07e847-f060-4dbb-846a-f052e5a6bf28 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.179962 Nov 23 14:35:12.848365 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 377/755] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:12 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:13.069090 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1794de70-2947-4dd6-a4f2-1d088a96afe9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:13.070000 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1794de70-2947-4dd6-a4f2-1d088a96afe9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:13.075971 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1794de70-2947-4dd6-a4f2-1d088a96afe9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:13.076220 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1794de70-2947-4dd6-a4f2-1d088a96afe9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:13.077025 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1794de70-2947-4dd6-a4f2-1d088a96afe9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:13.077460 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1794de70-2947-4dd6-a4f2-1d088a96afe9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:13.111842 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1794de70-2947-4dd6-a4f2-1d088a96afe9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041150 Nov 23 14:35:13.111842 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 379/756] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:35:13 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:13.750666 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-cbb7b5e3-3560-4e97-a0b9-c4a0df18612b req-048eb23c-8cc6-46b4-a44b-7e3f1894d68d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1ac082-a980-455a-a956-0e2c15214e47", "tag": "e6f176df-d717-49b9-b93b-6866d8771953"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:13.752208 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:35:13.752208 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:35:13.757169 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a50b2f07-3fbd-4db3-83c5-308612cc93f6 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:13.757637 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a50b2f07-3fbd-4db3-83c5-308612cc93f6 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:13.760935 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-cbb7b5e3-3560-4e97-a0b9-c4a0df18612b req-048eb23c-8cc6-46b4-a44b-7e3f1894d68d service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:13.761078 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-cbb7b5e3-3560-4e97-a0b9-c4a0df18612b req-048eb23c-8cc6-46b4-a44b-7e3f1894d68d service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:13.764216 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a50b2f07-3fbd-4db3-83c5-308612cc93f6 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:13.764705 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a50b2f07-3fbd-4db3-83c5-308612cc93f6 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:13.765542 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a50b2f07-3fbd-4db3-83c5-308612cc93f6 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:13.765968 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a50b2f07-3fbd-4db3-83c5-308612cc93f6 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:13.772357 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-cbb7b5e3-3560-4e97-a0b9-c4a0df18612b req-048eb23c-8cc6-46b4-a44b-7e3f1894d68d service nova] Creating event network-changed:e6f176df-d717-49b9-b93b-6866d8771953 for instance 3b1ac082-a980-455a-a956-0e2c15214e47 on hv-cinder-80475 Nov 23 14:35:13.777391 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-cbb7b5e3-3560-4e97-a0b9-c4a0df18612b req-048eb23c-8cc6-46b4-a44b-7e3f1894d68d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030485 Nov 23 14:35:13.778378 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 378/757] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:35:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:35:13.867235 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-312ca62a-1a94-4b71-a52a-e84c59db9a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:13.867927 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-312ca62a-1a94-4b71-a52a-e84c59db9a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:13.873992 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-312ca62a-1a94-4b71-a52a-e84c59db9a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:13.874648 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-312ca62a-1a94-4b71-a52a-e84c59db9a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:13.875707 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-312ca62a-1a94-4b71-a52a-e84c59db9a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:13.876136 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-312ca62a-1a94-4b71-a52a-e84c59db9a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:14.052157 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a50b2f07-3fbd-4db3-83c5-308612cc93f6 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:14.059838 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a50b2f07-3fbd-4db3-83c5-308612cc93f6 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1318 microversion: 2.1 time: 0.307151 Nov 23 14:35:14.066566 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 380/758] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:13 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:14.110730 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-312ca62a-1a94-4b71-a52a-e84c59db9a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:14.119512 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-154bc570-3a2e-4be0-b035-cadee65bee88 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:14.119938 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-312ca62a-1a94-4b71-a52a-e84c59db9a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:14.120472 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-154bc570-3a2e-4be0-b035-cadee65bee88 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:14.121620 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-312ca62a-1a94-4b71-a52a-e84c59db9a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:14.123008 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-312ca62a-1a94-4b71-a52a-e84c59db9a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.261697 Nov 23 14:35:14.123648 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 379/759] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:13 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:35:14.126599 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-154bc570-3a2e-4be0-b035-cadee65bee88 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:14.127052 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-154bc570-3a2e-4be0-b035-cadee65bee88 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:14.128499 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-154bc570-3a2e-4be0-b035-cadee65bee88 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:14.130875 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-154bc570-3a2e-4be0-b035-cadee65bee88 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:14.159491 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-154bc570-3a2e-4be0-b035-cadee65bee88 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Nov 23 14:35:14.160054 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 381/760] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:35:14 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:15.081533 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b834a3ef-e8d5-4971-ae7b-e0b2d5d63a68 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:15.084733 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b834a3ef-e8d5-4971-ae7b-e0b2d5d63a68 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:15.088409 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b834a3ef-e8d5-4971-ae7b-e0b2d5d63a68 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:15.088857 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b834a3ef-e8d5-4971-ae7b-e0b2d5d63a68 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:15.089627 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b834a3ef-e8d5-4971-ae7b-e0b2d5d63a68 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:15.090053 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b834a3ef-e8d5-4971-ae7b-e0b2d5d63a68 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:15.142024 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bb60bc87-1f82-4399-a4a9-58e133ac424c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:15.143349 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bb60bc87-1f82-4399-a4a9-58e133ac424c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:15.149643 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bb60bc87-1f82-4399-a4a9-58e133ac424c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:15.150080 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bb60bc87-1f82-4399-a4a9-58e133ac424c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:15.151444 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bb60bc87-1f82-4399-a4a9-58e133ac424c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:15.151444 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bb60bc87-1f82-4399-a4a9-58e133ac424c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:15.225564 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-b834a3ef-e8d5-4971-ae7b-e0b2d5d63a68 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:15.232954 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b834a3ef-e8d5-4971-ae7b-e0b2d5d63a68 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1318 microversion: 2.1 time: 0.155128 Nov 23 14:35:15.233427 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 380/761] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:15 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:15.238095 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ceeef0ff-62f4-42e2-a7c9-45fd5d5e6862 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:15.239241 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ceeef0ff-62f4-42e2-a7c9-45fd5d5e6862 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:15.245526 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ceeef0ff-62f4-42e2-a7c9-45fd5d5e6862 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:15.246020 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ceeef0ff-62f4-42e2-a7c9-45fd5d5e6862 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:15.247031 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ceeef0ff-62f4-42e2-a7c9-45fd5d5e6862 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:15.247470 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ceeef0ff-62f4-42e2-a7c9-45fd5d5e6862 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:15.279733 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ceeef0ff-62f4-42e2-a7c9-45fd5d5e6862 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045081 Nov 23 14:35:15.280641 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 381/762] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:35:15 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:15.290882 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-bb60bc87-1f82-4399-a4a9-58e133ac424c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:15.298629 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-bb60bc87-1f82-4399-a4a9-58e133ac424c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:15.300291 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-bb60bc87-1f82-4399-a4a9-58e133ac424c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:15.301543 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bb60bc87-1f82-4399-a4a9-58e133ac424c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.163298 Nov 23 14:35:15.302178 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 382/763] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:15 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:35:16.249801 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-846ff658-00a9-4dc9-bb8a-48a51d502965 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:16.250409 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-846ff658-00a9-4dc9-bb8a-48a51d502965 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:16.257347 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-846ff658-00a9-4dc9-bb8a-48a51d502965 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:16.257803 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-846ff658-00a9-4dc9-bb8a-48a51d502965 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:16.258576 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-846ff658-00a9-4dc9-bb8a-48a51d502965 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:16.259016 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-846ff658-00a9-4dc9-bb8a-48a51d502965 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:16.292609 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f8a66c00-5e92-4531-9087-176d31680b0a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:16.293423 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f8a66c00-5e92-4531-9087-176d31680b0a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:16.300021 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f8a66c00-5e92-4531-9087-176d31680b0a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:16.300875 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f8a66c00-5e92-4531-9087-176d31680b0a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:16.302557 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f8a66c00-5e92-4531-9087-176d31680b0a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:16.303239 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f8a66c00-5e92-4531-9087-176d31680b0a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:16.336037 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f8a66c00-5e92-4531-9087-176d31680b0a tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047253 Nov 23 14:35:16.340061 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 383/764] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:35:16 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:16.341429 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bda1fd55-9abb-43de-8444-6c8bcc40fdfa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:16.342024 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bda1fd55-9abb-43de-8444-6c8bcc40fdfa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:16.348818 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bda1fd55-9abb-43de-8444-6c8bcc40fdfa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:16.349260 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bda1fd55-9abb-43de-8444-6c8bcc40fdfa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:16.350101 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bda1fd55-9abb-43de-8444-6c8bcc40fdfa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:16.350531 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bda1fd55-9abb-43de-8444-6c8bcc40fdfa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:16.497508 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-bda1fd55-9abb-43de-8444-6c8bcc40fdfa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:16.506247 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-bda1fd55-9abb-43de-8444-6c8bcc40fdfa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:16.507931 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-bda1fd55-9abb-43de-8444-6c8bcc40fdfa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:16.509338 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bda1fd55-9abb-43de-8444-6c8bcc40fdfa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.171248 Nov 23 14:35:16.509899 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 384/765] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:16 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:16.540957 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-846ff658-00a9-4dc9-bb8a-48a51d502965 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:16.556586 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-846ff658-00a9-4dc9-bb8a-48a51d502965 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1318 microversion: 2.1 time: 0.310187 Nov 23 14:35:16.557065 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 382/766] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:16 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:17.267217 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-310a45da-28ea-40ca-bd86-78a26c3836f0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:17.274673 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-310a45da-28ea-40ca-bd86-78a26c3836f0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:17.275117 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-310a45da-28ea-40ca-bd86-78a26c3836f0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:17.340435 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-310a45da-28ea-40ca-bd86-78a26c3836f0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Going to try to stop instance {{(pid=116788) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 23 14:35:17.349135 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-498590e3-f08d-4100-9c2a-32ed0794cc9b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:17.356445 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-498590e3-f08d-4100-9c2a-32ed0794cc9b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:17.356445 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-498590e3-f08d-4100-9c2a-32ed0794cc9b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:17.356737 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-498590e3-f08d-4100-9c2a-32ed0794cc9b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:17.357403 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-498590e3-f08d-4100-9c2a-32ed0794cc9b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:17.358019 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-498590e3-f08d-4100-9c2a-32ed0794cc9b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:17.393711 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-498590e3-f08d-4100-9c2a-32ed0794cc9b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049587 Nov 23 14:35:17.395791 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 383/767] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:35:17 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:17.528105 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d4eb762b-ade5-41df-84b1-295c2397b7dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:17.528746 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d4eb762b-ade5-41df-84b1-295c2397b7dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:17.534774 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d4eb762b-ade5-41df-84b1-295c2397b7dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:17.535948 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d4eb762b-ade5-41df-84b1-295c2397b7dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:17.536720 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d4eb762b-ade5-41df-84b1-295c2397b7dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:17.537155 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d4eb762b-ade5-41df-84b1-295c2397b7dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:17.539195 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-310a45da-28ea-40ca-bd86-78a26c3836f0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 202 len: 0 microversion: 2.1 time: 0.276158 Nov 23 14:35:17.539875 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 385/768] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:35:17 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:35:17.549000 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-267b10c5-d9b0-4a95-910c-a0283e1c3eb0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:17.549713 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-267b10c5-d9b0-4a95-910c-a0283e1c3eb0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:17.556229 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-267b10c5-d9b0-4a95-910c-a0283e1c3eb0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:17.556693 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-267b10c5-d9b0-4a95-910c-a0283e1c3eb0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:17.557465 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-267b10c5-d9b0-4a95-910c-a0283e1c3eb0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:17.558070 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-267b10c5-d9b0-4a95-910c-a0283e1c3eb0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:17.685448 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d4eb762b-ade5-41df-84b1-295c2397b7dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:17.693258 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d4eb762b-ade5-41df-84b1-295c2397b7dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:17.694770 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d4eb762b-ade5-41df-84b1-295c2397b7dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:17.695927 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d4eb762b-ade5-41df-84b1-295c2397b7dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.171594 Nov 23 14:35:17.696520 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 384/769] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:17 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:35:17.700821 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6fd06ad6-cdb6-4194-b974-46baa941abc0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:17.701424 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6fd06ad6-cdb6-4194-b974-46baa941abc0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:17.702944 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-267b10c5-d9b0-4a95-910c-a0283e1c3eb0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:17.707483 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6fd06ad6-cdb6-4194-b974-46baa941abc0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:17.708556 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6fd06ad6-cdb6-4194-b974-46baa941abc0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:17.709120 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6fd06ad6-cdb6-4194-b974-46baa941abc0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:17.709549 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6fd06ad6-cdb6-4194-b974-46baa941abc0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:17.712100 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-267b10c5-d9b0-4a95-910c-a0283e1c3eb0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1724 microversion: 2.1 time: 0.166897 Nov 23 14:35:17.713017 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 386/770] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:17 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:17.863371 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6fd06ad6-cdb6-4194-b974-46baa941abc0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:17.870896 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6fd06ad6-cdb6-4194-b974-46baa941abc0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1318 microversion: 2.1 time: 0.173429 Nov 23 14:35:17.871460 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 385/771] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:17 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:18.405418 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9d6db64f-fab1-4d53-b0e0-b663455a00d0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:18.406934 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9d6db64f-fab1-4d53-b0e0-b663455a00d0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:18.413492 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9d6db64f-fab1-4d53-b0e0-b663455a00d0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:18.413942 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9d6db64f-fab1-4d53-b0e0-b663455a00d0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:18.414725 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9d6db64f-fab1-4d53-b0e0-b663455a00d0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:18.415176 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9d6db64f-fab1-4d53-b0e0-b663455a00d0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:18.444905 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9d6db64f-fab1-4d53-b0e0-b663455a00d0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043267 Nov 23 14:35:18.445472 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 387/772] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:35:18 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:35:18.714680 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e5d7b441-070c-49e5-96b0-53f6bc705574 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:18.715291 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e5d7b441-070c-49e5-96b0-53f6bc705574 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:18.721627 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e5d7b441-070c-49e5-96b0-53f6bc705574 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:18.722079 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e5d7b441-070c-49e5-96b0-53f6bc705574 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:18.722857 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e5d7b441-070c-49e5-96b0-53f6bc705574 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:18.723967 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e5d7b441-070c-49e5-96b0-53f6bc705574 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:18.729840 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f93cd091-97f9-447a-b172-5c1f3013716d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:18.730795 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f93cd091-97f9-447a-b172-5c1f3013716d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:18.739784 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f93cd091-97f9-447a-b172-5c1f3013716d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:18.740582 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f93cd091-97f9-447a-b172-5c1f3013716d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:18.746506 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f93cd091-97f9-447a-b172-5c1f3013716d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:18.746506 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f93cd091-97f9-447a-b172-5c1f3013716d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:18.907032 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-f93cd091-97f9-447a-b172-5c1f3013716d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:18.916814 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f93cd091-97f9-447a-b172-5c1f3013716d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1724 microversion: 2.1 time: 0.190581 Nov 23 14:35:18.917517 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 388/773] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:18 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:18.922936 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ea8f7a0f-5507-4255-8c04-21d6eb501d02 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:18.923833 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ea8f7a0f-5507-4255-8c04-21d6eb501d02 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:18.931202 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ea8f7a0f-5507-4255-8c04-21d6eb501d02 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:18.931742 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ea8f7a0f-5507-4255-8c04-21d6eb501d02 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:18.932645 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ea8f7a0f-5507-4255-8c04-21d6eb501d02 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:18.933142 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ea8f7a0f-5507-4255-8c04-21d6eb501d02 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:18.945712 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e5d7b441-070c-49e5-96b0-53f6bc705574 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:18.986514 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e5d7b441-070c-49e5-96b0-53f6bc705574 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:18.987909 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e5d7b441-070c-49e5-96b0-53f6bc705574 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:18.989832 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e5d7b441-070c-49e5-96b0-53f6bc705574 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.279400 Nov 23 14:35:18.990833 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 386/774] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:18 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:19.077844 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ea8f7a0f-5507-4255-8c04-21d6eb501d02 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:19.086186 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ea8f7a0f-5507-4255-8c04-21d6eb501d02 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1318 microversion: 2.1 time: 0.167561 Nov 23 14:35:19.086752 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 389/775] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:18 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:19.935029 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2db03e52-a7a1-4384-a6b2-1939e5b32403 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:19.935655 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2db03e52-a7a1-4384-a6b2-1939e5b32403 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:19.941892 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2db03e52-a7a1-4384-a6b2-1939e5b32403 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:19.942447 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2db03e52-a7a1-4384-a6b2-1939e5b32403 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:19.943229 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2db03e52-a7a1-4384-a6b2-1939e5b32403 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:19.943662 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2db03e52-a7a1-4384-a6b2-1939e5b32403 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:19.998111 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3f524033-0d7e-4166-a546-0413282262e4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:19.998618 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3f524033-0d7e-4166-a546-0413282262e4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:20.005756 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3f524033-0d7e-4166-a546-0413282262e4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:20.006194 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3f524033-0d7e-4166-a546-0413282262e4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:20.007405 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3f524033-0d7e-4166-a546-0413282262e4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:20.007405 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3f524033-0d7e-4166-a546-0413282262e4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:20.033510 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3f524033-0d7e-4166-a546-0413282262e4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Going to try to terminate instance {{(pid=116788) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:35:20.079123 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2db03e52-a7a1-4384-a6b2-1939e5b32403 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:20.088019 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2db03e52-a7a1-4384-a6b2-1939e5b32403 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1724 microversion: 2.1 time: 0.156662 Nov 23 14:35:20.088612 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 387/776] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:19 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:20.098709 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-43535ef9-dd96-4748-8e9e-8e8d352d9acd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:20.098709 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-43535ef9-dd96-4748-8e9e-8e8d352d9acd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:20.099406 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-43535ef9-dd96-4748-8e9e-8e8d352d9acd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:20.099853 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-43535ef9-dd96-4748-8e9e-8e8d352d9acd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:20.100663 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-43535ef9-dd96-4748-8e9e-8e8d352d9acd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:20.101097 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-43535ef9-dd96-4748-8e9e-8e8d352d9acd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:20.241710 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-43535ef9-dd96-4748-8e9e-8e8d352d9acd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:20.249264 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-43535ef9-dd96-4748-8e9e-8e8d352d9acd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:20.250748 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-43535ef9-dd96-4748-8e9e-8e8d352d9acd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:20.251927 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-43535ef9-dd96-4748-8e9e-8e8d352d9acd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.162378 Nov 23 14:35:20.252475 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 388/777] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:20 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:20.256818 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9ae4f9ec-9523-4cc5-8db3-64112d2e33b2 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:20.257413 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9ae4f9ec-9523-4cc5-8db3-64112d2e33b2 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:20.263069 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9ae4f9ec-9523-4cc5-8db3-64112d2e33b2 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:20.263546 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9ae4f9ec-9523-4cc5-8db3-64112d2e33b2 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:20.264339 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9ae4f9ec-9523-4cc5-8db3-64112d2e33b2 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:20.264768 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9ae4f9ec-9523-4cc5-8db3-64112d2e33b2 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:20.294634 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3f524033-0d7e-4166-a546-0413282262e4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "DELETE /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 204 len: 0 microversion: 2.1 time: 0.299932 Nov 23 14:35:20.295227 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 390/778] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:35:19 2021] DELETE /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 14:35:20.304323 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f768ae71-ffa6-4600-871a-f378a7d4b94d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:20.305042 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f768ae71-ffa6-4600-871a-f378a7d4b94d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:20.311258 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f768ae71-ffa6-4600-871a-f378a7d4b94d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:20.311700 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f768ae71-ffa6-4600-871a-f378a7d4b94d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:20.312512 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f768ae71-ffa6-4600-871a-f378a7d4b94d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:20.312960 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f768ae71-ffa6-4600-871a-f378a7d4b94d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:20.407885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9ae4f9ec-9523-4cc5-8db3-64112d2e33b2 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:20.415819 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9ae4f9ec-9523-4cc5-8db3-64112d2e33b2 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1318 microversion: 2.1 time: 0.162380 Nov 23 14:35:20.416422 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 389/779] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:20 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:20.450482 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-f768ae71-ffa6-4600-871a-f378a7d4b94d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:20.459546 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f768ae71-ffa6-4600-871a-f378a7d4b94d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1512 microversion: 2.1 time: 0.159826 Nov 23 14:35:20.460357 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 391/780] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:20 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:21.105321 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b83e6937-5d58-4e3f-888d-98a86eb5c51b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:21.105849 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b83e6937-5d58-4e3f-888d-98a86eb5c51b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:21.112015 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b83e6937-5d58-4e3f-888d-98a86eb5c51b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:21.112492 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b83e6937-5d58-4e3f-888d-98a86eb5c51b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:21.113772 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b83e6937-5d58-4e3f-888d-98a86eb5c51b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:21.114288 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b83e6937-5d58-4e3f-888d-98a86eb5c51b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:21.254094 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-b83e6937-5d58-4e3f-888d-98a86eb5c51b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:21.255898 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b83e6937-5d58-4e3f-888d-98a86eb5c51b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1724 microversion: 2.1 time: 0.154357 Nov 23 14:35:21.256481 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 390/781] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:21 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:21.270537 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-87a32a24-92e2-47ba-9b0d-b9c7e9746379 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:21.271150 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-87a32a24-92e2-47ba-9b0d-b9c7e9746379 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:21.277730 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-87a32a24-92e2-47ba-9b0d-b9c7e9746379 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:21.278172 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-87a32a24-92e2-47ba-9b0d-b9c7e9746379 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:21.278974 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-87a32a24-92e2-47ba-9b0d-b9c7e9746379 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:21.279395 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-87a32a24-92e2-47ba-9b0d-b9c7e9746379 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:21.409364 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-87a32a24-92e2-47ba-9b0d-b9c7e9746379 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:21.417546 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-87a32a24-92e2-47ba-9b0d-b9c7e9746379 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:21.419029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-87a32a24-92e2-47ba-9b0d-b9c7e9746379 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:21.420170 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-87a32a24-92e2-47ba-9b0d-b9c7e9746379 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.153618 Nov 23 14:35:21.420766 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 392/782] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:21 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:21.432420 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9367fb58-7f8f-423b-8b35-ed495e59d5f0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:21.433105 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9367fb58-7f8f-423b-8b35-ed495e59d5f0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:21.438971 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9367fb58-7f8f-423b-8b35-ed495e59d5f0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:21.439510 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9367fb58-7f8f-423b-8b35-ed495e59d5f0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:21.440454 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9367fb58-7f8f-423b-8b35-ed495e59d5f0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:21.440954 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9367fb58-7f8f-423b-8b35-ed495e59d5f0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:21.477057 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-39ecb820-1b1e-4165-9f49-99ea11e7037d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:21.477665 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-39ecb820-1b1e-4165-9f49-99ea11e7037d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:21.483599 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-39ecb820-1b1e-4165-9f49-99ea11e7037d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:21.484051 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-39ecb820-1b1e-4165-9f49-99ea11e7037d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:21.484872 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-39ecb820-1b1e-4165-9f49-99ea11e7037d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:21.485305 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-39ecb820-1b1e-4165-9f49-99ea11e7037d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:21.572095 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9367fb58-7f8f-423b-8b35-ed495e59d5f0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:21.579560 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9367fb58-7f8f-423b-8b35-ed495e59d5f0 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1318 microversion: 2.1 time: 0.150999 Nov 23 14:35:21.580391 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 391/783] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:21 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:21.620158 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-39ecb820-1b1e-4165-9f49-99ea11e7037d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:21.627392 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-39ecb820-1b1e-4165-9f49-99ea11e7037d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1512 microversion: 2.1 time: 0.154489 Nov 23 14:35:21.627948 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 393/784] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:21 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:22.273191 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5b915c6b-016e-4139-8d9e-c6a9c9ab6084 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:22.273893 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5b915c6b-016e-4139-8d9e-c6a9c9ab6084 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:22.280093 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5b915c6b-016e-4139-8d9e-c6a9c9ab6084 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:22.280577 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5b915c6b-016e-4139-8d9e-c6a9c9ab6084 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:22.281607 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5b915c6b-016e-4139-8d9e-c6a9c9ab6084 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:22.282041 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5b915c6b-016e-4139-8d9e-c6a9c9ab6084 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:22.416685 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5b915c6b-016e-4139-8d9e-c6a9c9ab6084 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:22.424905 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5b915c6b-016e-4139-8d9e-c6a9c9ab6084 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1724 microversion: 2.1 time: 0.155655 Nov 23 14:35:22.434816 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 392/785] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:22 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:22.440114 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-259481c2-adb0-4a2c-8229-c4a765aaf5d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:22.440969 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-259481c2-adb0-4a2c-8229-c4a765aaf5d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:22.449456 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-259481c2-adb0-4a2c-8229-c4a765aaf5d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:22.450033 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-259481c2-adb0-4a2c-8229-c4a765aaf5d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:22.450987 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-259481c2-adb0-4a2c-8229-c4a765aaf5d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:22.451440 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-259481c2-adb0-4a2c-8229-c4a765aaf5d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:22.583347 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-259481c2-adb0-4a2c-8229-c4a765aaf5d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:22.591272 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-259481c2-adb0-4a2c-8229-c4a765aaf5d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:22.592789 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-259481c2-adb0-4a2c-8229-c4a765aaf5d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:22.593980 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-259481c2-adb0-4a2c-8229-c4a765aaf5d7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.157672 Nov 23 14:35:22.594542 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 394/786] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:22 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:22.611187 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-012a480b-d98c-4581-92d8-41b5ff241461 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:22.613665 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-012a480b-d98c-4581-92d8-41b5ff241461 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:22.618813 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-012a480b-d98c-4581-92d8-41b5ff241461 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:22.619270 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-012a480b-d98c-4581-92d8-41b5ff241461 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:22.620048 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-012a480b-d98c-4581-92d8-41b5ff241461 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:22.620513 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-012a480b-d98c-4581-92d8-41b5ff241461 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:22.631986 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-80b58c6d-b9df-4162-b8c0-47c92f79cd10 req-19cc0776-5e6e-46fe-b48f-bdf2a64b8cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1ac082-a980-455a-a956-0e2c15214e47", "name": "network-vif-plugged", "status": "completed", "tag": "e6f176df-d717-49b9-b93b-6866d8771953"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:22.633635 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:35:22.633635 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:35:22.641603 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-80b58c6d-b9df-4162-b8c0-47c92f79cd10 req-19cc0776-5e6e-46fe-b48f-bdf2a64b8cb9 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:22.642048 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-80b58c6d-b9df-4162-b8c0-47c92f79cd10 req-19cc0776-5e6e-46fe-b48f-bdf2a64b8cb9 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:22.653338 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-80b58c6d-b9df-4162-b8c0-47c92f79cd10 req-19cc0776-5e6e-46fe-b48f-bdf2a64b8cb9 service nova] Creating event network-vif-plugged:e6f176df-d717-49b9-b93b-6866d8771953 for instance 3b1ac082-a980-455a-a956-0e2c15214e47 on hv-cinder-80475 Nov 23 14:35:22.658352 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-80b58c6d-b9df-4162-b8c0-47c92f79cd10 req-19cc0776-5e6e-46fe-b48f-bdf2a64b8cb9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030730 Nov 23 14:35:22.658967 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 395/787] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:35:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:35:22.666727 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-298b0370-df1e-4f35-a296-66182129447c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:22.667421 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-298b0370-df1e-4f35-a296-66182129447c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:22.673432 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-298b0370-df1e-4f35-a296-66182129447c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:22.673874 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-298b0370-df1e-4f35-a296-66182129447c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:22.674692 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-298b0370-df1e-4f35-a296-66182129447c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:22.675062 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-298b0370-df1e-4f35-a296-66182129447c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:22.781594 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-012a480b-d98c-4581-92d8-41b5ff241461 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:22.782263 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-012a480b-d98c-4581-92d8-41b5ff241461 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1318 microversion: 2.1 time: 0.173322 Nov 23 14:35:22.783160 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 393/788] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:22 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:22.841321 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-298b0370-df1e-4f35-a296-66182129447c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:22.849423 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-298b0370-df1e-4f35-a296-66182129447c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1512 microversion: 2.1 time: 0.186380 Nov 23 14:35:22.850142 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 396/789] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:22 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:23.443184 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ca3454de-72cf-4257-9c3f-c89b3aa391ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:23.443827 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ca3454de-72cf-4257-9c3f-c89b3aa391ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:23.450186 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ca3454de-72cf-4257-9c3f-c89b3aa391ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:23.450636 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ca3454de-72cf-4257-9c3f-c89b3aa391ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:23.451395 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ca3454de-72cf-4257-9c3f-c89b3aa391ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:23.451985 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ca3454de-72cf-4257-9c3f-c89b3aa391ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:23.580491 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ca3454de-72cf-4257-9c3f-c89b3aa391ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:23.588287 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ca3454de-72cf-4257-9c3f-c89b3aa391ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1724 microversion: 2.1 time: 0.149569 Nov 23 14:35:23.588851 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 394/790] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:23 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:23.613365 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-524525e9-19f1-4ca9-b970-68fea0a4f307 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:23.613947 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-524525e9-19f1-4ca9-b970-68fea0a4f307 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:23.620064 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-524525e9-19f1-4ca9-b970-68fea0a4f307 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:23.620535 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-524525e9-19f1-4ca9-b970-68fea0a4f307 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:23.621297 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-524525e9-19f1-4ca9-b970-68fea0a4f307 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:23.621721 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-524525e9-19f1-4ca9-b970-68fea0a4f307 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:23.758396 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-524525e9-19f1-4ca9-b970-68fea0a4f307 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:23.766182 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-524525e9-19f1-4ca9-b970-68fea0a4f307 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:23.767676 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-524525e9-19f1-4ca9-b970-68fea0a4f307 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:23.768858 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-524525e9-19f1-4ca9-b970-68fea0a4f307 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.159909 Nov 23 14:35:23.769636 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 397/791] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:23 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:23.798759 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ac012e40-d622-4879-9848-3f43094158bd tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:23.799395 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ac012e40-d622-4879-9848-3f43094158bd tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:23.805970 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ac012e40-d622-4879-9848-3f43094158bd tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:23.806419 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ac012e40-d622-4879-9848-3f43094158bd tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:23.807188 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ac012e40-d622-4879-9848-3f43094158bd tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:23.807645 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ac012e40-d622-4879-9848-3f43094158bd tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:23.866762 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6bc4d359-f4e2-4b5f-b1c8-2b555efa4b9d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:23.867305 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6bc4d359-f4e2-4b5f-b1c8-2b555efa4b9d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:23.873153 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6bc4d359-f4e2-4b5f-b1c8-2b555efa4b9d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:23.873594 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6bc4d359-f4e2-4b5f-b1c8-2b555efa4b9d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:23.874400 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6bc4d359-f4e2-4b5f-b1c8-2b555efa4b9d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:23.874831 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6bc4d359-f4e2-4b5f-b1c8-2b555efa4b9d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:24.011463 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6bc4d359-f4e2-4b5f-b1c8-2b555efa4b9d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:24.018882 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6bc4d359-f4e2-4b5f-b1c8-2b555efa4b9d tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1512 microversion: 2.1 time: 0.156048 Nov 23 14:35:24.019508 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 398/792] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:23 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:24.033067 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ac012e40-d622-4879-9848-3f43094158bd tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:24.041599 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ac012e40-d622-4879-9848-3f43094158bd tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1318 microversion: 2.1 time: 0.246637 Nov 23 14:35:24.042287 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 395/793] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:23 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:24.284290 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-92d589fc-e6a5-45a0-a21d-a1add00ce720 req-5087b5e3-23a6-4581-b8b5-f59f709e61dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "debd017d-9965-4cc4-8998-8827fb2a1072", "name": "network-vif-deleted", "tag": "740e4a45-0299-43d8-aef2-b8d7f6c87383"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:24.286346 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:35:24.286346 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:35:24.293673 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-92d589fc-e6a5-45a0-a21d-a1add00ce720 req-5087b5e3-23a6-4581-b8b5-f59f709e61dc service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:24.294106 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-92d589fc-e6a5-45a0-a21d-a1add00ce720 req-5087b5e3-23a6-4581-b8b5-f59f709e61dc service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:24.306374 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-92d589fc-e6a5-45a0-a21d-a1add00ce720 req-5087b5e3-23a6-4581-b8b5-f59f709e61dc service nova] Creating event network-vif-deleted:740e4a45-0299-43d8-aef2-b8d7f6c87383 for instance debd017d-9965-4cc4-8998-8827fb2a1072 on hv-cinder-80475 Nov 23 14:35:24.311238 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-92d589fc-e6a5-45a0-a21d-a1add00ce720 req-5087b5e3-23a6-4581-b8b5-f59f709e61dc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030947 Nov 23 14:35:24.311839 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 399/794] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:35:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:24.605385 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-45abbb73-8c2c-43f8-ad28-25d8afe40aed tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:24.606001 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-45abbb73-8c2c-43f8-ad28-25d8afe40aed tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:24.612130 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45abbb73-8c2c-43f8-ad28-25d8afe40aed tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:24.613216 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45abbb73-8c2c-43f8-ad28-25d8afe40aed tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:24.618902 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45abbb73-8c2c-43f8-ad28-25d8afe40aed tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:24.618902 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45abbb73-8c2c-43f8-ad28-25d8afe40aed tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:24.746415 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-45abbb73-8c2c-43f8-ad28-25d8afe40aed tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:24.754440 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-45abbb73-8c2c-43f8-ad28-25d8afe40aed tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1724 microversion: 2.1 time: 0.152825 Nov 23 14:35:24.755001 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 396/795] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:24 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:24.788602 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e4f205d4-0973-4ef3-95ee-41fab5b43da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:24.789294 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e4f205d4-0973-4ef3-95ee-41fab5b43da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:24.795327 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e4f205d4-0973-4ef3-95ee-41fab5b43da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:24.795767 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e4f205d4-0973-4ef3-95ee-41fab5b43da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:24.796557 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e4f205d4-0973-4ef3-95ee-41fab5b43da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:24.796997 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e4f205d4-0973-4ef3-95ee-41fab5b43da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:24.929864 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e4f205d4-0973-4ef3-95ee-41fab5b43da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:24.937440 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e4f205d4-0973-4ef3-95ee-41fab5b43da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:24.938935 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e4f205d4-0973-4ef3-95ee-41fab5b43da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:24.940062 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e4f205d4-0973-4ef3-95ee-41fab5b43da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.156850 Nov 23 14:35:24.941255 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 400/796] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:24 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:25.035883 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e19d3eaf-d8f8-4819-b375-5725c6cd53a4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:25.036452 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e19d3eaf-d8f8-4819-b375-5725c6cd53a4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:25.042208 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e19d3eaf-d8f8-4819-b375-5725c6cd53a4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:25.042659 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e19d3eaf-d8f8-4819-b375-5725c6cd53a4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:25.043433 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e19d3eaf-d8f8-4819-b375-5725c6cd53a4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:25.043869 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e19d3eaf-d8f8-4819-b375-5725c6cd53a4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:25.058696 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5dfd46b3-0293-498d-a01d-a0f28ff21acb tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:25.063766 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5dfd46b3-0293-498d-a01d-a0f28ff21acb tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:25.065254 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5dfd46b3-0293-498d-a01d-a0f28ff21acb tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:25.066290 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5dfd46b3-0293-498d-a01d-a0f28ff21acb tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:25.067242 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5dfd46b3-0293-498d-a01d-a0f28ff21acb tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:25.067681 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5dfd46b3-0293-498d-a01d-a0f28ff21acb tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:25.077093 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e19d3eaf-d8f8-4819-b375-5725c6cd53a4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:25.077548 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e19d3eaf-d8f8-4819-b375-5725c6cd53a4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:25.078000 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-e19d3eaf-d8f8-4819-b375-5725c6cd53a4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lazy-loading 'fault' on Instance uuid debd017d-9965-4cc4-8998-8827fb2a1072 {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:35:25.117083 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e19d3eaf-d8f8-4819-b375-5725c6cd53a4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:25.124166 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e19d3eaf-d8f8-4819-b375-5725c6cd53a4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1307 microversion: 2.1 time: 0.092161 Nov 23 14:35:25.124779 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 397/797] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:25 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:25.197256 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5dfd46b3-0293-498d-a01d-a0f28ff21acb tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:25.204326 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5dfd46b3-0293-498d-a01d-a0f28ff21acb tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1318 microversion: 2.1 time: 0.149202 Nov 23 14:35:25.204888 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 401/798] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:25 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:25.771641 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-93a53c73-a486-48fb-9f68-b6e154d879c6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:25.772285 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-93a53c73-a486-48fb-9f68-b6e154d879c6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:25.778875 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-93a53c73-a486-48fb-9f68-b6e154d879c6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:25.779319 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-93a53c73-a486-48fb-9f68-b6e154d879c6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:25.780370 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-93a53c73-a486-48fb-9f68-b6e154d879c6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:25.780921 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-93a53c73-a486-48fb-9f68-b6e154d879c6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:25.917061 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-93a53c73-a486-48fb-9f68-b6e154d879c6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:25.925567 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-93a53c73-a486-48fb-9f68-b6e154d879c6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1724 microversion: 2.1 time: 0.157762 Nov 23 14:35:25.926134 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 398/799] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:25 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:25.959244 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c16e1f02-1bc8-47af-9856-56400e70721e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:25.959846 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c16e1f02-1bc8-47af-9856-56400e70721e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:25.966443 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c16e1f02-1bc8-47af-9856-56400e70721e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:25.966883 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c16e1f02-1bc8-47af-9856-56400e70721e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:25.967741 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c16e1f02-1bc8-47af-9856-56400e70721e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:25.968185 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c16e1f02-1bc8-47af-9856-56400e70721e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:26.114265 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c16e1f02-1bc8-47af-9856-56400e70721e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:26.123068 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c16e1f02-1bc8-47af-9856-56400e70721e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:26.124638 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c16e1f02-1bc8-47af-9856-56400e70721e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:26.130036 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c16e1f02-1bc8-47af-9856-56400e70721e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1744 microversion: 2.20 time: 0.170845 Nov 23 14:35:26.130036 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 402/800] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:25 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:26.140716 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f65d6e16-880e-4a01-94e7-ecee3288db8f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:26.141312 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f65d6e16-880e-4a01-94e7-ecee3288db8f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:26.147068 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f65d6e16-880e-4a01-94e7-ecee3288db8f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:26.147515 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f65d6e16-880e-4a01-94e7-ecee3288db8f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:26.148303 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f65d6e16-880e-4a01-94e7-ecee3288db8f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:26.148732 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f65d6e16-880e-4a01-94e7-ecee3288db8f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:26.183472 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f65d6e16-880e-4a01-94e7-ecee3288db8f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:26.183909 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f65d6e16-880e-4a01-94e7-ecee3288db8f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:26.184491 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-f65d6e16-880e-4a01-94e7-ecee3288db8f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lazy-loading 'fault' on Instance uuid debd017d-9965-4cc4-8998-8827fb2a1072 {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:35:26.220923 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d96f6bb1-b313-4a82-9ad6-cc8ed095771a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:26.222078 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d96f6bb1-b313-4a82-9ad6-cc8ed095771a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:26.225603 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f65d6e16-880e-4a01-94e7-ecee3288db8f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:26.228497 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d96f6bb1-b313-4a82-9ad6-cc8ed095771a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:26.228945 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d96f6bb1-b313-4a82-9ad6-cc8ed095771a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:26.229920 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d96f6bb1-b313-4a82-9ad6-cc8ed095771a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:26.230366 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d96f6bb1-b313-4a82-9ad6-cc8ed095771a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:26.232474 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f65d6e16-880e-4a01-94e7-ecee3288db8f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 200 len: 1307 microversion: 2.1 time: 0.095286 Nov 23 14:35:26.233208 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 399/801] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:26 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:26.379408 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d96f6bb1-b313-4a82-9ad6-cc8ed095771a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:26.387496 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d96f6bb1-b313-4a82-9ad6-cc8ed095771a tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1506 microversion: 2.1 time: 0.170323 Nov 23 14:35:26.388085 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 403/802] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:26 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:26.406273 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f836aaf2-9fb3-4779-b2bb-2394c0e12d47 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cd361fb-aead-43db-83c5-38bf4bedeba4", "device": "/dev/sdb"}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:26.408288 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f836aaf2-9fb3-4779-b2bb-2394c0e12d47 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:26.415357 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f836aaf2-9fb3-4779-b2bb-2394c0e12d47 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:26.415800 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f836aaf2-9fb3-4779-b2bb-2394c0e12d47 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:26.416610 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f836aaf2-9fb3-4779-b2bb-2394c0e12d47 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:26.417725 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f836aaf2-9fb3-4779-b2bb-2394c0e12d47 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:26.943852 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-757718ef-b794-4fa7-9ce0-ff4ab1153a0e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:26.944942 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-757718ef-b794-4fa7-9ce0-ff4ab1153a0e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:26.951048 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-757718ef-b794-4fa7-9ce0-ff4ab1153a0e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:26.951658 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-757718ef-b794-4fa7-9ce0-ff4ab1153a0e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:26.952548 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-757718ef-b794-4fa7-9ce0-ff4ab1153a0e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:26.953079 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-757718ef-b794-4fa7-9ce0-ff4ab1153a0e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:27.104025 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-757718ef-b794-4fa7-9ce0-ff4ab1153a0e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:27.111992 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-757718ef-b794-4fa7-9ce0-ff4ab1153a0e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1724 microversion: 2.1 time: 0.172282 Nov 23 14:35:27.113203 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 404/803] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:26 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:27.145042 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-114d9951-3735-47fe-8c03-7f8ec9f26f12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:27.145673 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-114d9951-3735-47fe-8c03-7f8ec9f26f12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:27.151479 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-114d9951-3735-47fe-8c03-7f8ec9f26f12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:27.151927 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-114d9951-3735-47fe-8c03-7f8ec9f26f12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:27.152730 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-114d9951-3735-47fe-8c03-7f8ec9f26f12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:27.153209 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-114d9951-3735-47fe-8c03-7f8ec9f26f12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:27.240035 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f836aaf2-9fb3-4779-b2bb-2394c0e12d47 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "POST /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.837601 Nov 23 14:35:27.240921 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 400/804] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Nov 23 14:35:26 2021] POST /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47/os-volume_attachments => generated 194 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:27.253539 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-006813a8-e950-4c37-b282-82859d049097 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:27.254307 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-006813a8-e950-4c37-b282-82859d049097 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: debd017d-9965-4cc4-8998-8827fb2a1072] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:27.260589 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-006813a8-e950-4c37-b282-82859d049097 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:27.261317 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-006813a8-e950-4c37-b282-82859d049097 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:27.262325 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-006813a8-e950-4c37-b282-82859d049097 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:27.262821 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-006813a8-e950-4c37-b282-82859d049097 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:27.277155 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-006813a8-e950-4c37-b282-82859d049097 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] HTTP exception thrown: Instance debd017d-9965-4cc4-8998-8827fb2a1072 could not be found. Nov 23 14:35:27.277819 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-006813a8-e950-4c37-b282-82859d049097 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Returning 404 to user: Instance debd017d-9965-4cc4-8998-8827fb2a1072 could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:35:27.278707 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-006813a8-e950-4c37-b282-82859d049097 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072" status: 404 len: 111 microversion: 2.1 time: 0.029829 Nov 23 14:35:27.282611 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 401/805] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:27 2021] GET /compute/v2.1/servers/debd017d-9965-4cc4-8998-8827fb2a1072 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:35:27.309438 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-114d9951-3735-47fe-8c03-7f8ec9f26f12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:27.318081 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-114d9951-3735-47fe-8c03-7f8ec9f26f12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:27.319580 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-114d9951-3735-47fe-8c03-7f8ec9f26f12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:27.320847 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-114d9951-3735-47fe-8c03-7f8ec9f26f12 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1744 microversion: 2.20 time: 0.180394 Nov 23 14:35:27.321418 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 405/806] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:27 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:35:28.129151 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-fc3b4395-0e1e-4cb9-b428-c635be364e0c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:28.129762 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-fc3b4395-0e1e-4cb9-b428-c635be364e0c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:28.135918 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc3b4395-0e1e-4cb9-b428-c635be364e0c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:28.136388 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc3b4395-0e1e-4cb9-b428-c635be364e0c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:28.137156 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc3b4395-0e1e-4cb9-b428-c635be364e0c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:28.137591 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc3b4395-0e1e-4cb9-b428-c635be364e0c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:28.273545 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-fc3b4395-0e1e-4cb9-b428-c635be364e0c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:28.281434 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-fc3b4395-0e1e-4cb9-b428-c635be364e0c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1724 microversion: 2.1 time: 0.156029 Nov 23 14:35:28.281974 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 402/807] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:28 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:28.338642 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-4cef9c7e-f679-473f-ac9e-0c89f3ce1fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:28.339251 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-4cef9c7e-f679-473f-ac9e-0c89f3ce1fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:28.345637 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4cef9c7e-f679-473f-ac9e-0c89f3ce1fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:28.346786 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4cef9c7e-f679-473f-ac9e-0c89f3ce1fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:28.347482 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4cef9c7e-f679-473f-ac9e-0c89f3ce1fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:28.347482 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4cef9c7e-f679-473f-ac9e-0c89f3ce1fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:28.477516 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-4cef9c7e-f679-473f-ac9e-0c89f3ce1fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:28.485493 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-4cef9c7e-f679-473f-ac9e-0c89f3ce1fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:28.487180 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-4cef9c7e-f679-473f-ac9e-0c89f3ce1fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:28.488565 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-4cef9c7e-f679-473f-ac9e-0c89f3ce1fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1744 microversion: 2.20 time: 0.153512 Nov 23 14:35:28.489130 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 406/808] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:28 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:28.587274 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-456b5ad1-ec15-4145-ab73-c6f32af41ac4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:28.587768 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-456b5ad1-ec15-4145-ab73-c6f32af41ac4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:28.593607 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-456b5ad1-ec15-4145-ab73-c6f32af41ac4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:28.593988 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-456b5ad1-ec15-4145-ab73-c6f32af41ac4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:28.595001 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-456b5ad1-ec15-4145-ab73-c6f32af41ac4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:28.595478 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-456b5ad1-ec15-4145-ab73-c6f32af41ac4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:28.620082 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-456b5ad1-ec15-4145-ab73-c6f32af41ac4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Going to try to terminate instance {{(pid=116787) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:35:28.893495 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-456b5ad1-ec15-4145-ab73-c6f32af41ac4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "DELETE /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 204 len: 0 microversion: 2.1 time: 0.309097 Nov 23 14:35:28.894093 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 403/809] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:35:28 2021] DELETE /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 14:35:28.901974 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-920c2a3b-0f90-4330-ac7b-52bf05e76bde tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:28.904104 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-920c2a3b-0f90-4330-ac7b-52bf05e76bde tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:28.909539 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-920c2a3b-0f90-4330-ac7b-52bf05e76bde tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:28.910104 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-920c2a3b-0f90-4330-ac7b-52bf05e76bde tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:28.910963 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-920c2a3b-0f90-4330-ac7b-52bf05e76bde tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:28.911551 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-920c2a3b-0f90-4330-ac7b-52bf05e76bde tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:29.059207 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-920c2a3b-0f90-4330-ac7b-52bf05e76bde tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:29.066464 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-920c2a3b-0f90-4330-ac7b-52bf05e76bde tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1512 microversion: 2.1 time: 0.168313 Nov 23 14:35:29.067038 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 407/810] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:28 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:29.300215 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c41d8000-ed28-4d5b-8c1f-b18d5b4b408b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:29.300938 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c41d8000-ed28-4d5b-8c1f-b18d5b4b408b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:29.307167 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c41d8000-ed28-4d5b-8c1f-b18d5b4b408b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:29.307600 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c41d8000-ed28-4d5b-8c1f-b18d5b4b408b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:29.308493 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c41d8000-ed28-4d5b-8c1f-b18d5b4b408b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:29.308926 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c41d8000-ed28-4d5b-8c1f-b18d5b4b408b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:29.449748 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c41d8000-ed28-4d5b-8c1f-b18d5b4b408b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:29.458360 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c41d8000-ed28-4d5b-8c1f-b18d5b4b408b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1724 microversion: 2.1 time: 0.162730 Nov 23 14:35:29.458930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 404/811] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:29 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:29.506573 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-75c6d984-d304-43dc-9643-7891b5771fde tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:29.507101 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-75c6d984-d304-43dc-9643-7891b5771fde tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:29.513286 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-75c6d984-d304-43dc-9643-7891b5771fde tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:29.513727 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-75c6d984-d304-43dc-9643-7891b5771fde tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:29.514496 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-75c6d984-d304-43dc-9643-7891b5771fde tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:29.514923 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-75c6d984-d304-43dc-9643-7891b5771fde tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:29.644666 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-75c6d984-d304-43dc-9643-7891b5771fde tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:29.652571 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-75c6d984-d304-43dc-9643-7891b5771fde tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:29.653997 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-75c6d984-d304-43dc-9643-7891b5771fde tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:29.655399 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-75c6d984-d304-43dc-9643-7891b5771fde tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1744 microversion: 2.20 time: 0.152597 Nov 23 14:35:29.655961 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 408/812] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:29 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:35:30.084222 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f7c4afc5-f7f6-4bad-8d1d-c1395a346174 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:30.084857 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f7c4afc5-f7f6-4bad-8d1d-c1395a346174 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:30.090522 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f7c4afc5-f7f6-4bad-8d1d-c1395a346174 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:30.090970 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f7c4afc5-f7f6-4bad-8d1d-c1395a346174 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:30.091747 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f7c4afc5-f7f6-4bad-8d1d-c1395a346174 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:30.092174 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f7c4afc5-f7f6-4bad-8d1d-c1395a346174 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:30.222712 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f7c4afc5-f7f6-4bad-8d1d-c1395a346174 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:30.230073 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f7c4afc5-f7f6-4bad-8d1d-c1395a346174 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1512 microversion: 2.1 time: 0.150049 Nov 23 14:35:30.230575 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 405/813] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:30 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:30.487284 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bebdace5-312a-4b9d-9ab8-6c2187c30e80 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:30.487920 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bebdace5-312a-4b9d-9ab8-6c2187c30e80 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:30.493771 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bebdace5-312a-4b9d-9ab8-6c2187c30e80 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:30.494216 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bebdace5-312a-4b9d-9ab8-6c2187c30e80 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:30.494988 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bebdace5-312a-4b9d-9ab8-6c2187c30e80 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:30.495420 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bebdace5-312a-4b9d-9ab8-6c2187c30e80 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:30.599132 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-20714e88-5b7a-4f84-be2e-a48001ffca90 req-8e0ff67c-3a88-451a-b664-5aba41f7a1ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c8dbd0-2f80-4158-923b-24f263fd9832", "name": "network-vif-plugged", "status": "completed", "tag": "643c4469-7e07-47b2-806d-0dfc74abe378"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:30.600822 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:35:30.600822 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:35:30.607950 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-20714e88-5b7a-4f84-be2e-a48001ffca90 req-8e0ff67c-3a88-451a-b664-5aba41f7a1ff service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:30.608500 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-20714e88-5b7a-4f84-be2e-a48001ffca90 req-8e0ff67c-3a88-451a-b664-5aba41f7a1ff service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:30.620483 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-20714e88-5b7a-4f84-be2e-a48001ffca90 req-8e0ff67c-3a88-451a-b664-5aba41f7a1ff service nova] Creating event network-vif-plugged:643c4469-7e07-47b2-806d-0dfc74abe378 for instance f5c8dbd0-2f80-4158-923b-24f263fd9832 on hv-cinder-80475 Nov 23 14:35:30.625509 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-20714e88-5b7a-4f84-be2e-a48001ffca90 req-8e0ff67c-3a88-451a-b664-5aba41f7a1ff service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030841 Nov 23 14:35:30.626116 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 406/814] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:35:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:35:30.674861 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-444bd242-09f3-4b09-8016-d8bb202d3919 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:30.675740 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-444bd242-09f3-4b09-8016-d8bb202d3919 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:30.682147 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-444bd242-09f3-4b09-8016-d8bb202d3919 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:30.682501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-444bd242-09f3-4b09-8016-d8bb202d3919 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:30.683511 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-444bd242-09f3-4b09-8016-d8bb202d3919 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:30.683948 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-444bd242-09f3-4b09-8016-d8bb202d3919 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:30.822741 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-444bd242-09f3-4b09-8016-d8bb202d3919 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:30.831531 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-444bd242-09f3-4b09-8016-d8bb202d3919 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:30.833063 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-444bd242-09f3-4b09-8016-d8bb202d3919 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:30.834270 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-444bd242-09f3-4b09-8016-d8bb202d3919 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1744 microversion: 2.20 time: 0.163980 Nov 23 14:35:30.834820 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 407/815] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:30 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:35:30.856919 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-bebdace5-312a-4b9d-9ab8-6c2187c30e80 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:30.865434 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bebdace5-312a-4b9d-9ab8-6c2187c30e80 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1724 microversion: 2.1 time: 0.382371 Nov 23 14:35:30.866006 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 409/816] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:30 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:31.246754 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-bcafe6a3-2160-44f0-93eb-7032cc8283a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:31.247393 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-bcafe6a3-2160-44f0-93eb-7032cc8283a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:31.253113 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bcafe6a3-2160-44f0-93eb-7032cc8283a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:31.253565 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bcafe6a3-2160-44f0-93eb-7032cc8283a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:31.254338 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bcafe6a3-2160-44f0-93eb-7032cc8283a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:31.254767 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bcafe6a3-2160-44f0-93eb-7032cc8283a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:31.383685 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-bcafe6a3-2160-44f0-93eb-7032cc8283a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:31.390894 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-bcafe6a3-2160-44f0-93eb-7032cc8283a0 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1512 microversion: 2.1 time: 0.147850 Nov 23 14:35:31.391460 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 408/817] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:31 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:31.882934 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8961fedd-f186-4574-b479-baa646be6578 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:31.883585 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8961fedd-f186-4574-b479-baa646be6578 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:31.890273 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8961fedd-f186-4574-b479-baa646be6578 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:31.890721 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8961fedd-f186-4574-b479-baa646be6578 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:31.891535 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8961fedd-f186-4574-b479-baa646be6578 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:31.891971 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8961fedd-f186-4574-b479-baa646be6578 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:32.018653 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ace2554d-4660-4f48-9151-a2ea63034742 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:32.019802 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ace2554d-4660-4f48-9151-a2ea63034742 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:32.025764 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ace2554d-4660-4f48-9151-a2ea63034742 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:32.026219 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ace2554d-4660-4f48-9151-a2ea63034742 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:32.026998 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ace2554d-4660-4f48-9151-a2ea63034742 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:32.027427 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ace2554d-4660-4f48-9151-a2ea63034742 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:32.077936 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-8961fedd-f186-4574-b479-baa646be6578 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:32.086033 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8961fedd-f186-4574-b479-baa646be6578 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1724 microversion: 2.1 time: 0.206693 Nov 23 14:35:32.086612 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 409/818] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:31 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:32.158283 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ace2554d-4660-4f48-9151-a2ea63034742 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:32.166390 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ace2554d-4660-4f48-9151-a2ea63034742 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:32.167944 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ace2554d-4660-4f48-9151-a2ea63034742 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:32.169125 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ace2554d-4660-4f48-9151-a2ea63034742 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1744 microversion: 2.20 time: 0.320406 Nov 23 14:35:32.178041 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 410/819] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:31 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1744 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:35:32.247274 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-9289bc3d-6386-4474-bdb1-4dd81bcb6604 req-360c4475-1d83-45a7-b180-b15561b6d08d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c214697-d673-4304-b403-6624296f8ef2", "name": "network-vif-deleted", "tag": "33c40c31-9d6e-4241-9de7-e23035380d49"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:32.248853 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:35:32.248853 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:35:32.256157 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-9289bc3d-6386-4474-bdb1-4dd81bcb6604 req-360c4475-1d83-45a7-b180-b15561b6d08d service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:32.256896 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-9289bc3d-6386-4474-bdb1-4dd81bcb6604 req-360c4475-1d83-45a7-b180-b15561b6d08d service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:32.267888 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-9289bc3d-6386-4474-bdb1-4dd81bcb6604 req-360c4475-1d83-45a7-b180-b15561b6d08d service nova] Creating event network-vif-deleted:33c40c31-9d6e-4241-9de7-e23035380d49 for instance 1c214697-d673-4304-b403-6624296f8ef2 on hv-cinder-80475 Nov 23 14:35:32.272764 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-9289bc3d-6386-4474-bdb1-4dd81bcb6604 req-360c4475-1d83-45a7-b180-b15561b6d08d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029032 Nov 23 14:35:32.273537 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 410/820] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:35:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:32.406872 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d9724ca9-c36f-478d-a5eb-4c37f4a73338 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:32.407470 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d9724ca9-c36f-478d-a5eb-4c37f4a73338 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:32.413435 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d9724ca9-c36f-478d-a5eb-4c37f4a73338 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:32.413877 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d9724ca9-c36f-478d-a5eb-4c37f4a73338 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:32.414677 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d9724ca9-c36f-478d-a5eb-4c37f4a73338 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:32.415147 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d9724ca9-c36f-478d-a5eb-4c37f4a73338 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:32.474064 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d9724ca9-c36f-478d-a5eb-4c37f4a73338 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:32.481368 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d9724ca9-c36f-478d-a5eb-4c37f4a73338 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 200 len: 1302 microversion: 2.1 time: 0.078445 Nov 23 14:35:32.481939 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 411/821] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:32 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 1302 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:33.186599 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-4de35419-74d8-4d2f-af1d-fdfb2d74e605 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:33.187284 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-4de35419-74d8-4d2f-af1d-fdfb2d74e605 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:33.194185 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4de35419-74d8-4d2f-af1d-fdfb2d74e605 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:33.194633 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4de35419-74d8-4d2f-af1d-fdfb2d74e605 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:33.195474 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4de35419-74d8-4d2f-af1d-fdfb2d74e605 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:33.195935 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4de35419-74d8-4d2f-af1d-fdfb2d74e605 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:33.208715 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-389bc0f6-9219-481c-9664-da9c43b5d6c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:33.219821 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-389bc0f6-9219-481c-9664-da9c43b5d6c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:33.219821 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-389bc0f6-9219-481c-9664-da9c43b5d6c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:33.219821 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-389bc0f6-9219-481c-9664-da9c43b5d6c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:33.219821 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-389bc0f6-9219-481c-9664-da9c43b5d6c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:33.222753 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-389bc0f6-9219-481c-9664-da9c43b5d6c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:33.336076 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-4de35419-74d8-4d2f-af1d-fdfb2d74e605 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:33.344807 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-4de35419-74d8-4d2f-af1d-fdfb2d74e605 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:33.346624 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-4de35419-74d8-4d2f-af1d-fdfb2d74e605 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:33.347843 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-4de35419-74d8-4d2f-af1d-fdfb2d74e605 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1744 microversion: 2.20 time: 0.164852 Nov 23 14:35:33.348469 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 412/822] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:33 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:35:33.363792 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-389bc0f6-9219-481c-9664-da9c43b5d6c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:33.375239 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-389bc0f6-9219-481c-9664-da9c43b5d6c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1701 microversion: 2.1 time: 0.274228 Nov 23 14:35:33.375467 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 411/823] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:33 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1701 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:33.395875 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a4b44904-c80a-439c-9830-d8bf421181fc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:33.401776 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a4b44904-c80a-439c-9830-d8bf421181fc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:33.402214 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a4b44904-c80a-439c-9830-d8bf421181fc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:33.425271 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a4b44904-c80a-439c-9830-d8bf421181fc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Going to try to start instance {{(pid=116788) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 23 14:35:33.498668 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6a79f4e4-b750-484d-a2ca-718ac0aeb300 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:33.499189 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6a79f4e4-b750-484d-a2ca-718ac0aeb300 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 1c214697-d673-4304-b403-6624296f8ef2] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:33.505076 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a79f4e4-b750-484d-a2ca-718ac0aeb300 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:33.505530 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a79f4e4-b750-484d-a2ca-718ac0aeb300 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:33.506298 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a79f4e4-b750-484d-a2ca-718ac0aeb300 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:33.506730 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a79f4e4-b750-484d-a2ca-718ac0aeb300 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:33.519781 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-6a79f4e4-b750-484d-a2ca-718ac0aeb300 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] HTTP exception thrown: Instance 1c214697-d673-4304-b403-6624296f8ef2 could not be found. Nov 23 14:35:33.520391 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6a79f4e4-b750-484d-a2ca-718ac0aeb300 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Returning 404 to user: Instance 1c214697-d673-4304-b403-6624296f8ef2 could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:35:33.521205 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6a79f4e4-b750-484d-a2ca-718ac0aeb300 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2" status: 404 len: 111 microversion: 2.1 time: 0.026309 Nov 23 14:35:33.521732 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 412/824] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:33 2021] GET /compute/v2.1/servers/1c214697-d673-4304-b403-6624296f8ef2 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 14:35:33.529269 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3c8fc4c7-1083-4f29-ab6a-3b4f02f5f4e4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:33.529996 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3c8fc4c7-1083-4f29-ab6a-3b4f02f5f4e4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:33.536216 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3c8fc4c7-1083-4f29-ab6a-3b4f02f5f4e4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:33.539901 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3c8fc4c7-1083-4f29-ab6a-3b4f02f5f4e4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:33.539901 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3c8fc4c7-1083-4f29-ab6a-3b4f02f5f4e4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:33.539901 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3c8fc4c7-1083-4f29-ab6a-3b4f02f5f4e4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:33.565832 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3c8fc4c7-1083-4f29-ab6a-3b4f02f5f4e4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Going to try to terminate instance {{(pid=116787) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:35:33.660938 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a4b44904-c80a-439c-9830-d8bf421181fc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 202 len: 0 microversion: 2.1 time: 0.268521 Nov 23 14:35:33.661628 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 413/825] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:35:33 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:35:33.669422 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-20a36314-3c63-46f8-82eb-fd3002394c8e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:33.670112 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-20a36314-3c63-46f8-82eb-fd3002394c8e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:33.677031 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-20a36314-3c63-46f8-82eb-fd3002394c8e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:33.677476 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-20a36314-3c63-46f8-82eb-fd3002394c8e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:33.678293 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-20a36314-3c63-46f8-82eb-fd3002394c8e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:33.678957 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-20a36314-3c63-46f8-82eb-fd3002394c8e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:33.819933 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-20a36314-3c63-46f8-82eb-fd3002394c8e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:33.827849 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-20a36314-3c63-46f8-82eb-fd3002394c8e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1710 microversion: 2.1 time: 0.162108 Nov 23 14:35:33.828527 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 414/826] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:33 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:33.857706 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3c8fc4c7-1083-4f29-ab6a-3b4f02f5f4e4 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "DELETE /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 204 len: 0 microversion: 2.1 time: 0.331677 Nov 23 14:35:33.858501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 413/827] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:35:33 2021] DELETE /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 14:35:33.870194 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-2107ea37-0336-4b1e-aef7-c3d901cb7eaa tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:33.871514 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-2107ea37-0336-4b1e-aef7-c3d901cb7eaa tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:33.882097 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2107ea37-0336-4b1e-aef7-c3d901cb7eaa tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:33.882822 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2107ea37-0336-4b1e-aef7-c3d901cb7eaa tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:33.884129 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2107ea37-0336-4b1e-aef7-c3d901cb7eaa tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:33.884802 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2107ea37-0336-4b1e-aef7-c3d901cb7eaa tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:34.054367 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-2107ea37-0336-4b1e-aef7-c3d901cb7eaa tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:34.063512 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-2107ea37-0336-4b1e-aef7-c3d901cb7eaa tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1511 microversion: 2.1 time: 0.199813 Nov 23 14:35:34.065374 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 415/828] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:33 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1511 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:34.379355 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d8ace7fb-b536-4df0-936a-552046e76062 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:34.380050 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d8ace7fb-b536-4df0-936a-552046e76062 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:34.386729 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d8ace7fb-b536-4df0-936a-552046e76062 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:34.387140 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d8ace7fb-b536-4df0-936a-552046e76062 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:34.388111 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d8ace7fb-b536-4df0-936a-552046e76062 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:34.388719 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d8ace7fb-b536-4df0-936a-552046e76062 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:34.846824 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-036d97dd-3a96-4d28-8fdf-2380c00152ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:34.848079 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-036d97dd-3a96-4d28-8fdf-2380c00152ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:34.855000 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-036d97dd-3a96-4d28-8fdf-2380c00152ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:34.855888 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-036d97dd-3a96-4d28-8fdf-2380c00152ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:34.857048 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-036d97dd-3a96-4d28-8fdf-2380c00152ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:34.857692 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-036d97dd-3a96-4d28-8fdf-2380c00152ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:34.949709 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d8ace7fb-b536-4df0-936a-552046e76062 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:34.959125 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d8ace7fb-b536-4df0-936a-552046e76062 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:34.961558 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d8ace7fb-b536-4df0-936a-552046e76062 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:34.962968 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d8ace7fb-b536-4df0-936a-552046e76062 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1739 microversion: 2.20 time: 0.599370 Nov 23 14:35:34.974818 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 414/829] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:34 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1739 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:35.045176 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-036d97dd-3a96-4d28-8fdf-2380c00152ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:35.054135 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-036d97dd-3a96-4d28-8fdf-2380c00152ec tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1710 microversion: 2.1 time: 0.211938 Nov 23 14:35:35.055072 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 416/830] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:34 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1710 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:35.082429 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3058aacd-d300-49f8-9466-ea5ed90ca192 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:35.083385 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3058aacd-d300-49f8-9466-ea5ed90ca192 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:35.089596 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3058aacd-d300-49f8-9466-ea5ed90ca192 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:35.090488 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3058aacd-d300-49f8-9466-ea5ed90ca192 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:35.091461 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3058aacd-d300-49f8-9466-ea5ed90ca192 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:35.092159 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3058aacd-d300-49f8-9466-ea5ed90ca192 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:35.239801 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3058aacd-d300-49f8-9466-ea5ed90ca192 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:35.249076 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3058aacd-d300-49f8-9466-ea5ed90ca192 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1511 microversion: 2.1 time: 0.171428 Nov 23 14:35:35.249939 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 415/831] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:35 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:35.990765 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-28efa081-938b-40f9-9f68-ece09110a875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:35.990765 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-28efa081-938b-40f9-9f68-ece09110a875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:35.995439 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-28efa081-938b-40f9-9f68-ece09110a875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:35.995960 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-28efa081-938b-40f9-9f68-ece09110a875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:35.996763 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-28efa081-938b-40f9-9f68-ece09110a875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:35.997405 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-28efa081-938b-40f9-9f68-ece09110a875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:36.074408 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ad589c8e-7461-42f6-b335-63bf04288f8d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:36.075115 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ad589c8e-7461-42f6-b335-63bf04288f8d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:36.089705 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ad589c8e-7461-42f6-b335-63bf04288f8d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:36.096363 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ad589c8e-7461-42f6-b335-63bf04288f8d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:36.096363 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ad589c8e-7461-42f6-b335-63bf04288f8d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:36.096363 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ad589c8e-7461-42f6-b335-63bf04288f8d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:36.205893 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-28efa081-938b-40f9-9f68-ece09110a875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:36.215958 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-28efa081-938b-40f9-9f68-ece09110a875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:36.219451 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-28efa081-938b-40f9-9f68-ece09110a875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:36.222144 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-28efa081-938b-40f9-9f68-ece09110a875 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1739 microversion: 2.20 time: 0.238863 Nov 23 14:35:36.233897 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 417/832] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:35 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:36.250767 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ad589c8e-7461-42f6-b335-63bf04288f8d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:36.259492 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ad589c8e-7461-42f6-b335-63bf04288f8d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1710 microversion: 2.1 time: 0.188853 Nov 23 14:35:36.267004 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ab08eeed-6cad-4887-822b-47bfe2bcde75 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:36.269485 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ab08eeed-6cad-4887-822b-47bfe2bcde75 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:36.274441 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ab08eeed-6cad-4887-822b-47bfe2bcde75 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:36.275139 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ab08eeed-6cad-4887-822b-47bfe2bcde75 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:36.276381 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ab08eeed-6cad-4887-822b-47bfe2bcde75 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:36.277011 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ab08eeed-6cad-4887-822b-47bfe2bcde75 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:36.283401 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 416/833] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:36 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1710 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:36.492626 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ab08eeed-6cad-4887-822b-47bfe2bcde75 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:36.506176 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ab08eeed-6cad-4887-822b-47bfe2bcde75 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1511 microversion: 2.1 time: 0.238268 Nov 23 14:35:36.507063 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 418/834] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:36 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1511 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:37.202134 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-46490662-22fb-4303-a248-95b041644946 req-c3df9899-d1ac-4061-956e-e3d20b180048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cacec6ec-9dcb-43ce-96fe-15584c509e65", "name": "network-vif-deleted", "tag": "6eb8710c-9885-4985-b1fc-07ee28411a7c"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:37.209258 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:35:37.209258 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:35:37.221606 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-46490662-22fb-4303-a248-95b041644946 req-c3df9899-d1ac-4061-956e-e3d20b180048 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:37.229969 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-46490662-22fb-4303-a248-95b041644946 req-c3df9899-d1ac-4061-956e-e3d20b180048 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:37.240030 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-007ea468-4252-49bb-a695-7ebe99a7a3e0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:37.241307 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-007ea468-4252-49bb-a695-7ebe99a7a3e0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:37.256957 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-007ea468-4252-49bb-a695-7ebe99a7a3e0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:37.265220 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-007ea468-4252-49bb-a695-7ebe99a7a3e0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:37.265220 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-007ea468-4252-49bb-a695-7ebe99a7a3e0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:37.265220 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-007ea468-4252-49bb-a695-7ebe99a7a3e0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:37.265753 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-46490662-22fb-4303-a248-95b041644946 req-c3df9899-d1ac-4061-956e-e3d20b180048 service nova] Creating event network-vif-deleted:6eb8710c-9885-4985-b1fc-07ee28411a7c for instance cacec6ec-9dcb-43ce-96fe-15584c509e65 on hv-cinder-80475 Nov 23 14:35:37.274870 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-46490662-22fb-4303-a248-95b041644946 req-c3df9899-d1ac-4061-956e-e3d20b180048 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077732 Nov 23 14:35:37.277217 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 417/835] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:35:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:35:37.296398 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5054e90a-3bd4-48e3-b1ee-41339655aa17 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:37.298026 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5054e90a-3bd4-48e3-b1ee-41339655aa17 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:37.307387 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5054e90a-3bd4-48e3-b1ee-41339655aa17 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:37.311249 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5054e90a-3bd4-48e3-b1ee-41339655aa17 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:37.311249 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5054e90a-3bd4-48e3-b1ee-41339655aa17 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:37.311249 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5054e90a-3bd4-48e3-b1ee-41339655aa17 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:37.555729 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-007ea468-4252-49bb-a695-7ebe99a7a3e0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:37.562856 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5054e90a-3bd4-48e3-b1ee-41339655aa17 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:37.564785 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-007ea468-4252-49bb-a695-7ebe99a7a3e0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:37.566689 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-007ea468-4252-49bb-a695-7ebe99a7a3e0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:37.568049 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-007ea468-4252-49bb-a695-7ebe99a7a3e0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1739 microversion: 2.20 time: 0.331667 Nov 23 14:35:37.572689 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5054e90a-3bd4-48e3-b1ee-41339655aa17 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1714 microversion: 2.1 time: 0.291157 Nov 23 14:35:37.583799 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 419/836] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:37 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1739 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:37.589093 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 418/837] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:37 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1714 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:37.600151 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-769f9086-2387-4a80-bf66-1b47212b706c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:37.601397 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-769f9086-2387-4a80-bf66-1b47212b706c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:37.618863 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-769f9086-2387-4a80-bf66-1b47212b706c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:37.619601 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-769f9086-2387-4a80-bf66-1b47212b706c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:37.620648 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-769f9086-2387-4a80-bf66-1b47212b706c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:37.621236 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-769f9086-2387-4a80-bf66-1b47212b706c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:37.668544 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-769f9086-2387-4a80-bf66-1b47212b706c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:37.668544 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-769f9086-2387-4a80-bf66-1b47212b706c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:37.668544 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.objects.instance [None req-769f9086-2387-4a80-bf66-1b47212b706c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lazy-loading 'fault' on Instance uuid cacec6ec-9dcb-43ce-96fe-15584c509e65 {{(pid=116788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:35:37.719664 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-769f9086-2387-4a80-bf66-1b47212b706c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:37.727415 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-769f9086-2387-4a80-bf66-1b47212b706c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1306 microversion: 2.1 time: 0.130881 Nov 23 14:35:37.728092 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 420/838] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:37 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1306 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:38.587062 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-874d4724-eb01-4297-9024-a9b12ae847a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:38.587695 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-874d4724-eb01-4297-9024-a9b12ae847a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:38.598300 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-874d4724-eb01-4297-9024-a9b12ae847a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:38.598950 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-874d4724-eb01-4297-9024-a9b12ae847a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:38.599753 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-874d4724-eb01-4297-9024-a9b12ae847a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:38.600229 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-874d4724-eb01-4297-9024-a9b12ae847a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:38.745801 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-274365db-60da-4bc4-8dd1-4408e78e6c25 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:38.747061 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-274365db-60da-4bc4-8dd1-4408e78e6c25 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:38.748796 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-874d4724-eb01-4297-9024-a9b12ae847a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:38.754485 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-274365db-60da-4bc4-8dd1-4408e78e6c25 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:38.755036 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-274365db-60da-4bc4-8dd1-4408e78e6c25 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:38.756033 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-274365db-60da-4bc4-8dd1-4408e78e6c25 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:38.756489 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-274365db-60da-4bc4-8dd1-4408e78e6c25 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:38.758270 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-874d4724-eb01-4297-9024-a9b12ae847a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:38.759854 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-874d4724-eb01-4297-9024-a9b12ae847a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:38.761138 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-874d4724-eb01-4297-9024-a9b12ae847a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1739 microversion: 2.20 time: 0.177925 Nov 23 14:35:38.773030 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 419/839] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:38 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:38.789602 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-274365db-60da-4bc4-8dd1-4408e78e6c25 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:38.790300 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-274365db-60da-4bc4-8dd1-4408e78e6c25 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:38.790743 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.objects.instance [None req-274365db-60da-4bc4-8dd1-4408e78e6c25 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lazy-loading 'fault' on Instance uuid cacec6ec-9dcb-43ce-96fe-15584c509e65 {{(pid=116788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:35:38.837252 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-274365db-60da-4bc4-8dd1-4408e78e6c25 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:38.845773 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-274365db-60da-4bc4-8dd1-4408e78e6c25 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1306 microversion: 2.1 time: 0.104228 Nov 23 14:35:38.855764 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 421/840] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:38 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1306 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:39.780291 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a32c9d8e-0ab6-4389-9609-766323b11f2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:39.780850 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a32c9d8e-0ab6-4389-9609-766323b11f2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:39.787349 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a32c9d8e-0ab6-4389-9609-766323b11f2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:39.787785 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a32c9d8e-0ab6-4389-9609-766323b11f2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:39.788794 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a32c9d8e-0ab6-4389-9609-766323b11f2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:39.789382 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a32c9d8e-0ab6-4389-9609-766323b11f2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:39.863743 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ed692bb7-9993-4f15-a0f3-5added3a000f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:39.865251 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ed692bb7-9993-4f15-a0f3-5added3a000f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:39.873175 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ed692bb7-9993-4f15-a0f3-5added3a000f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:39.873713 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ed692bb7-9993-4f15-a0f3-5added3a000f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:39.874969 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ed692bb7-9993-4f15-a0f3-5added3a000f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:39.876193 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ed692bb7-9993-4f15-a0f3-5added3a000f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:39.913074 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ed692bb7-9993-4f15-a0f3-5added3a000f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:39.913519 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ed692bb7-9993-4f15-a0f3-5added3a000f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:39.913964 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.objects.instance [None req-ed692bb7-9993-4f15-a0f3-5added3a000f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lazy-loading 'fault' on Instance uuid cacec6ec-9dcb-43ce-96fe-15584c509e65 {{(pid=116788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:35:39.958401 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ed692bb7-9993-4f15-a0f3-5added3a000f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:39.963595 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a32c9d8e-0ab6-4389-9609-766323b11f2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:39.968326 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ed692bb7-9993-4f15-a0f3-5added3a000f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 200 len: 1306 microversion: 2.1 time: 0.108229 Nov 23 14:35:39.969293 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 422/841] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:39 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 1306 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:39.980760 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a32c9d8e-0ab6-4389-9609-766323b11f2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:39.982279 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a32c9d8e-0ab6-4389-9609-766323b11f2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:39.983449 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a32c9d8e-0ab6-4389-9609-766323b11f2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1739 microversion: 2.20 time: 0.207222 Nov 23 14:35:39.984002 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 420/842] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:39 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:35:40.984191 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-af613b6a-bdd6-484e-9bc7-f7fc18a9c717 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:40.984903 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-af613b6a-bdd6-484e-9bc7-f7fc18a9c717 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: cacec6ec-9dcb-43ce-96fe-15584c509e65] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:40.991255 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-af613b6a-bdd6-484e-9bc7-f7fc18a9c717 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:40.991698 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-af613b6a-bdd6-484e-9bc7-f7fc18a9c717 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:40.992499 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-af613b6a-bdd6-484e-9bc7-f7fc18a9c717 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:40.992930 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-af613b6a-bdd6-484e-9bc7-f7fc18a9c717 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:41.003361 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-877d01ff-f4ec-4736-b42d-708a9b5cfc81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:41.003962 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-877d01ff-f4ec-4736-b42d-708a9b5cfc81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:41.006730 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-af613b6a-bdd6-484e-9bc7-f7fc18a9c717 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] HTTP exception thrown: Instance cacec6ec-9dcb-43ce-96fe-15584c509e65 could not be found. Nov 23 14:35:41.007315 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-af613b6a-bdd6-484e-9bc7-f7fc18a9c717 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Returning 404 to user: Instance cacec6ec-9dcb-43ce-96fe-15584c509e65 could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:35:41.014283 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-af613b6a-bdd6-484e-9bc7-f7fc18a9c717 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65" status: 404 len: 111 microversion: 2.1 time: 0.027654 Nov 23 14:35:41.056220 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-877d01ff-f4ec-4736-b42d-708a9b5cfc81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:41.056220 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-877d01ff-f4ec-4736-b42d-708a9b5cfc81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:41.057383 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 423/843] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:40 2021] GET /compute/v2.1/servers/cacec6ec-9dcb-43ce-96fe-15584c509e65 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:35:41.057485 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-877d01ff-f4ec-4736-b42d-708a9b5cfc81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:41.057485 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-877d01ff-f4ec-4736-b42d-708a9b5cfc81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:41.149973 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-877d01ff-f4ec-4736-b42d-708a9b5cfc81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:41.158323 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-877d01ff-f4ec-4736-b42d-708a9b5cfc81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:41.159798 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-877d01ff-f4ec-4736-b42d-708a9b5cfc81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:41.160975 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-877d01ff-f4ec-4736-b42d-708a9b5cfc81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1739 microversion: 2.20 time: 0.161974 Nov 23 14:35:41.161528 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 421/844] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:40 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:35:42.179663 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-95b1f116-abb0-43b4-a81f-dc84766d55a8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:42.180394 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-95b1f116-abb0-43b4-a81f-dc84766d55a8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:42.186761 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-95b1f116-abb0-43b4-a81f-dc84766d55a8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:42.187544 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-95b1f116-abb0-43b4-a81f-dc84766d55a8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:42.188718 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-95b1f116-abb0-43b4-a81f-dc84766d55a8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:42.189239 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-95b1f116-abb0-43b4-a81f-dc84766d55a8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:42.343970 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-95b1f116-abb0-43b4-a81f-dc84766d55a8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:42.358888 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-95b1f116-abb0-43b4-a81f-dc84766d55a8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:42.360801 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-95b1f116-abb0-43b4-a81f-dc84766d55a8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:42.362438 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-95b1f116-abb0-43b4-a81f-dc84766d55a8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1739 microversion: 2.20 time: 0.186786 Nov 23 14:35:42.363483 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 424/845] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:42 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:35:43.381498 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-cc4b261e-94a1-448d-87db-41288c8757b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:43.382108 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-cc4b261e-94a1-448d-87db-41288c8757b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:43.388350 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cc4b261e-94a1-448d-87db-41288c8757b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:43.388803 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cc4b261e-94a1-448d-87db-41288c8757b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:43.389719 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cc4b261e-94a1-448d-87db-41288c8757b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:43.390742 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cc4b261e-94a1-448d-87db-41288c8757b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:43.536080 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-cc4b261e-94a1-448d-87db-41288c8757b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:43.544349 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-cc4b261e-94a1-448d-87db-41288c8757b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:43.545853 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-cc4b261e-94a1-448d-87db-41288c8757b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:43.547831 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-cc4b261e-94a1-448d-87db-41288c8757b0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1739 microversion: 2.20 time: 0.170168 Nov 23 14:35:43.548832 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 422/846] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:43 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:44.569789 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-356b69da-63b8-4caa-a108-09c823ea9b16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:44.570421 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-356b69da-63b8-4caa-a108-09c823ea9b16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:44.576361 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-356b69da-63b8-4caa-a108-09c823ea9b16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:44.576805 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-356b69da-63b8-4caa-a108-09c823ea9b16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:44.577693 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-356b69da-63b8-4caa-a108-09c823ea9b16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:44.578187 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-356b69da-63b8-4caa-a108-09c823ea9b16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:44.721517 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-356b69da-63b8-4caa-a108-09c823ea9b16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:44.731711 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-356b69da-63b8-4caa-a108-09c823ea9b16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:44.735023 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-356b69da-63b8-4caa-a108-09c823ea9b16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:44.736437 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-356b69da-63b8-4caa-a108-09c823ea9b16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1739 microversion: 2.20 time: 0.174831 Nov 23 14:35:44.737222 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 425/847] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:44 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:35:45.551348 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b6c7ae54-fdc1-4e72-a499-f26931e0e137 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:45.551981 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b6c7ae54-fdc1-4e72-a499-f26931e0e137 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:45.558817 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b6c7ae54-fdc1-4e72-a499-f26931e0e137 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:45.559300 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b6c7ae54-fdc1-4e72-a499-f26931e0e137 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:45.560207 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b6c7ae54-fdc1-4e72-a499-f26931e0e137 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:45.560527 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b6c7ae54-fdc1-4e72-a499-f26931e0e137 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:45.587631 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b6c7ae54-fdc1-4e72-a499-f26931e0e137 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Going to try to terminate instance {{(pid=116787) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:35:45.754788 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d893db4d-5f4f-4a46-a651-f5335e4f01fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:45.755578 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d893db4d-5f4f-4a46-a651-f5335e4f01fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:45.761934 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d893db4d-5f4f-4a46-a651-f5335e4f01fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:45.762386 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d893db4d-5f4f-4a46-a651-f5335e4f01fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:45.763209 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d893db4d-5f4f-4a46-a651-f5335e4f01fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:45.763644 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d893db4d-5f4f-4a46-a651-f5335e4f01fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:45.885568 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b6c7ae54-fdc1-4e72-a499-f26931e0e137 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "DELETE /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 204 len: 0 microversion: 2.1 time: 0.337346 Nov 23 14:35:45.887166 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 423/848] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:35:45 2021] DELETE /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 14:35:45.896072 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-72a0b0ba-98d7-4e91-b570-01516b01521b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:45.896830 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-72a0b0ba-98d7-4e91-b570-01516b01521b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:45.903137 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-72a0b0ba-98d7-4e91-b570-01516b01521b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:45.903602 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-72a0b0ba-98d7-4e91-b570-01516b01521b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:45.904582 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-72a0b0ba-98d7-4e91-b570-01516b01521b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:45.906085 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-72a0b0ba-98d7-4e91-b570-01516b01521b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:45.947277 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d893db4d-5f4f-4a46-a651-f5335e4f01fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:45.956221 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d893db4d-5f4f-4a46-a651-f5335e4f01fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:45.957870 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d893db4d-5f4f-4a46-a651-f5335e4f01fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:45.959251 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d893db4d-5f4f-4a46-a651-f5335e4f01fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1739 microversion: 2.20 time: 0.208140 Nov 23 14:35:45.959819 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 426/849] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:45 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:35:46.146209 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-72a0b0ba-98d7-4e91-b570-01516b01521b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:46.153868 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-72a0b0ba-98d7-4e91-b570-01516b01521b tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1514 microversion: 2.1 time: 0.262095 Nov 23 14:35:46.154438 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 424/850] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:45 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:46.977744 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-dce94a12-d403-4c04-97e7-35e9efad2a56 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:46.978346 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-dce94a12-d403-4c04-97e7-35e9efad2a56 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:46.984895 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dce94a12-d403-4c04-97e7-35e9efad2a56 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:46.985350 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dce94a12-d403-4c04-97e7-35e9efad2a56 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:46.986125 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dce94a12-d403-4c04-97e7-35e9efad2a56 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:46.986558 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dce94a12-d403-4c04-97e7-35e9efad2a56 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:47.116070 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-dce94a12-d403-4c04-97e7-35e9efad2a56 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:47.124435 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-dce94a12-d403-4c04-97e7-35e9efad2a56 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:47.126000 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-dce94a12-d403-4c04-97e7-35e9efad2a56 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:47.127181 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-dce94a12-d403-4c04-97e7-35e9efad2a56 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1739 microversion: 2.20 time: 0.153080 Nov 23 14:35:47.127742 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 427/851] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:46 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:47.171259 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-da012d7f-9271-4eb5-9d7d-9739b909ea86 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:47.171863 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-da012d7f-9271-4eb5-9d7d-9739b909ea86 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:47.178252 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-da012d7f-9271-4eb5-9d7d-9739b909ea86 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:47.178700 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-da012d7f-9271-4eb5-9d7d-9739b909ea86 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:47.179483 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-da012d7f-9271-4eb5-9d7d-9739b909ea86 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:47.179920 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-da012d7f-9271-4eb5-9d7d-9739b909ea86 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:47.317160 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-da012d7f-9271-4eb5-9d7d-9739b909ea86 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:47.324708 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-da012d7f-9271-4eb5-9d7d-9739b909ea86 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1514 microversion: 2.1 time: 0.157639 Nov 23 14:35:47.325281 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 425/852] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:47 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:48.145853 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-25b119b4-5196-4614-97b7-d0006a4ffb2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:48.146457 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-25b119b4-5196-4614-97b7-d0006a4ffb2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:48.153036 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-25b119b4-5196-4614-97b7-d0006a4ffb2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:48.153492 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-25b119b4-5196-4614-97b7-d0006a4ffb2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:48.154269 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-25b119b4-5196-4614-97b7-d0006a4ffb2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:48.154878 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-25b119b4-5196-4614-97b7-d0006a4ffb2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:48.317023 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-25b119b4-5196-4614-97b7-d0006a4ffb2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:48.324688 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-25b119b4-5196-4614-97b7-d0006a4ffb2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:48.326181 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-25b119b4-5196-4614-97b7-d0006a4ffb2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:48.327477 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-25b119b4-5196-4614-97b7-d0006a4ffb2d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1739 microversion: 2.20 time: 0.185322 Nov 23 14:35:48.328034 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 428/853] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:48 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:48.341584 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-35fc3d9a-7183-48c8-ac50-d3fa8d4be87f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:48.342191 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-35fc3d9a-7183-48c8-ac50-d3fa8d4be87f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:48.348550 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-35fc3d9a-7183-48c8-ac50-d3fa8d4be87f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:48.351885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-35fc3d9a-7183-48c8-ac50-d3fa8d4be87f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:48.351885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-35fc3d9a-7183-48c8-ac50-d3fa8d4be87f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:48.351885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-35fc3d9a-7183-48c8-ac50-d3fa8d4be87f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:48.493200 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-35fc3d9a-7183-48c8-ac50-d3fa8d4be87f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:48.501211 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-35fc3d9a-7183-48c8-ac50-d3fa8d4be87f tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1514 microversion: 2.1 time: 0.163432 Nov 23 14:35:48.501874 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 426/854] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:48 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:49.345777 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-8dbe5fc8-4812-4054-870f-b1488a666daa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:49.346376 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-8dbe5fc8-4812-4054-870f-b1488a666daa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:49.353238 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8dbe5fc8-4812-4054-870f-b1488a666daa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:49.353688 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8dbe5fc8-4812-4054-870f-b1488a666daa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:49.354500 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8dbe5fc8-4812-4054-870f-b1488a666daa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:49.354934 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8dbe5fc8-4812-4054-870f-b1488a666daa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:49.521134 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-8dbe5fc8-4812-4054-870f-b1488a666daa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:49.521134 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-8dbe5fc8-4812-4054-870f-b1488a666daa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:49.523738 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-8dbe5fc8-4812-4054-870f-b1488a666daa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:49.523738 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-8dbe5fc8-4812-4054-870f-b1488a666daa tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1739 microversion: 2.20 time: 0.167240 Nov 23 14:35:49.523738 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 429/855] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:49 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:49.524010 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5ecfabd7-cf17-434c-95f6-a1b5a17116c6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:49.524010 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5ecfabd7-cf17-434c-95f6-a1b5a17116c6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:49.526269 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5ecfabd7-cf17-434c-95f6-a1b5a17116c6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:49.527009 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5ecfabd7-cf17-434c-95f6-a1b5a17116c6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:49.527294 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5ecfabd7-cf17-434c-95f6-a1b5a17116c6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:49.527728 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5ecfabd7-cf17-434c-95f6-a1b5a17116c6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:49.660753 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5ecfabd7-cf17-434c-95f6-a1b5a17116c6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:49.667983 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5ecfabd7-cf17-434c-95f6-a1b5a17116c6 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1514 microversion: 2.1 time: 0.152508 Nov 23 14:35:49.668577 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 427/856] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:49 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:50.528743 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b5aafd11-5e46-4e82-93aa-acdfd6640a36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:50.529659 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b5aafd11-5e46-4e82-93aa-acdfd6640a36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:50.537357 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b5aafd11-5e46-4e82-93aa-acdfd6640a36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:50.537804 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b5aafd11-5e46-4e82-93aa-acdfd6640a36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:50.538577 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b5aafd11-5e46-4e82-93aa-acdfd6640a36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:50.539009 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b5aafd11-5e46-4e82-93aa-acdfd6640a36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:50.668514 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-b5aafd11-5e46-4e82-93aa-acdfd6640a36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:50.676720 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-b5aafd11-5e46-4e82-93aa-acdfd6640a36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:50.678207 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-b5aafd11-5e46-4e82-93aa-acdfd6640a36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:50.679356 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b5aafd11-5e46-4e82-93aa-acdfd6640a36 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1739 microversion: 2.20 time: 0.154593 Nov 23 14:35:50.688768 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 430/857] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:50 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:50.688939 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3ca01de0-8bc7-4e6a-8014-49dda4874081 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:50.688939 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3ca01de0-8bc7-4e6a-8014-49dda4874081 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:50.692221 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3ca01de0-8bc7-4e6a-8014-49dda4874081 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:50.692701 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3ca01de0-8bc7-4e6a-8014-49dda4874081 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:50.693470 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3ca01de0-8bc7-4e6a-8014-49dda4874081 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:50.693897 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3ca01de0-8bc7-4e6a-8014-49dda4874081 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:50.822618 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3ca01de0-8bc7-4e6a-8014-49dda4874081 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:50.830272 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3ca01de0-8bc7-4e6a-8014-49dda4874081 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1514 microversion: 2.1 time: 0.149190 Nov 23 14:35:50.830840 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 428/858] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:50 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:51.698504 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-928d5967-f04f-4117-93fe-c81a421f7d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:51.699210 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-928d5967-f04f-4117-93fe-c81a421f7d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:51.706335 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-928d5967-f04f-4117-93fe-c81a421f7d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:51.706776 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-928d5967-f04f-4117-93fe-c81a421f7d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:51.707616 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-928d5967-f04f-4117-93fe-c81a421f7d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:51.708044 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-928d5967-f04f-4117-93fe-c81a421f7d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:51.844004 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-928d5967-f04f-4117-93fe-c81a421f7d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:51.846977 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-954b90d6-88db-4f71-8f9f-740e0af3b161 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:51.847588 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-954b90d6-88db-4f71-8f9f-740e0af3b161 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:51.852177 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-928d5967-f04f-4117-93fe-c81a421f7d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:51.853721 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-954b90d6-88db-4f71-8f9f-740e0af3b161 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:51.853868 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-928d5967-f04f-4117-93fe-c81a421f7d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:51.854169 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-954b90d6-88db-4f71-8f9f-740e0af3b161 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:51.854988 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-954b90d6-88db-4f71-8f9f-740e0af3b161 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:51.855190 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-928d5967-f04f-4117-93fe-c81a421f7d5e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1721 microversion: 2.20 time: 0.160413 Nov 23 14:35:51.855451 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-954b90d6-88db-4f71-8f9f-740e0af3b161 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:51.856202 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 431/859] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:51 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:52.082480 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-954b90d6-88db-4f71-8f9f-740e0af3b161 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:52.090036 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-954b90d6-88db-4f71-8f9f-740e0af3b161 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1514 microversion: 2.1 time: 0.246667 Nov 23 14:35:52.090597 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 429/860] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:51 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1514 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:52.874025 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a0377089-902d-4abc-9820-100b2c7ac2af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:52.875745 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a0377089-902d-4abc-9820-100b2c7ac2af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:52.882125 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a0377089-902d-4abc-9820-100b2c7ac2af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:52.884731 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a0377089-902d-4abc-9820-100b2c7ac2af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:52.884731 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a0377089-902d-4abc-9820-100b2c7ac2af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:52.884731 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a0377089-902d-4abc-9820-100b2c7ac2af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:53.023322 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a0377089-902d-4abc-9820-100b2c7ac2af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:53.031628 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a0377089-902d-4abc-9820-100b2c7ac2af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:53.033199 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a0377089-902d-4abc-9820-100b2c7ac2af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:53.034517 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a0377089-902d-4abc-9820-100b2c7ac2af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1721 microversion: 2.20 time: 0.164112 Nov 23 14:35:53.035153 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 432/861] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:52 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:53.107930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-da933538-7d1d-42cf-9c1e-cb64aa07397c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:53.111579 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-da933538-7d1d-42cf-9c1e-cb64aa07397c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:53.117309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-da933538-7d1d-42cf-9c1e-cb64aa07397c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:53.118049 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-da933538-7d1d-42cf-9c1e-cb64aa07397c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:53.119072 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-da933538-7d1d-42cf-9c1e-cb64aa07397c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:53.119613 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-da933538-7d1d-42cf-9c1e-cb64aa07397c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:53.195069 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-da933538-7d1d-42cf-9c1e-cb64aa07397c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f5f781b89d41e091d59e326a5e4db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '368da8317e0d4261811a214a941624dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:53.203096 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-da933538-7d1d-42cf-9c1e-cb64aa07397c tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 200 len: 1472 microversion: 2.1 time: 0.099113 Nov 23 14:35:53.213793 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 430/862] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:53 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 1472 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:53.340354 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-b89119c8-3070-49e4-bd56-e172355fe737 req-5f693fcc-9206-42a8-96bd-f90f4c91109d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b4442f-25b2-4695-a16f-17263d9e1710", "name": "network-vif-deleted", "tag": "50cd9224-27b2-4dca-bbbc-d56748cb8f48"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:53.344208 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:35:53.344208 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:35:53.351255 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-b89119c8-3070-49e4-bd56-e172355fe737 req-5f693fcc-9206-42a8-96bd-f90f4c91109d service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:53.351703 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-b89119c8-3070-49e4-bd56-e172355fe737 req-5f693fcc-9206-42a8-96bd-f90f4c91109d service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:53.364057 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-b89119c8-3070-49e4-bd56-e172355fe737 req-5f693fcc-9206-42a8-96bd-f90f4c91109d service nova] Creating event network-vif-deleted:50cd9224-27b2-4dca-bbbc-d56748cb8f48 for instance 43b4442f-25b2-4695-a16f-17263d9e1710 on hv-cinder-80475 Nov 23 14:35:53.369373 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-b89119c8-3070-49e4-bd56-e172355fe737 req-5f693fcc-9206-42a8-96bd-f90f4c91109d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216592 Nov 23 14:35:53.370127 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 433/863] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:35:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:54.053109 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-57f39e22-303b-4c34-ab12-de622375b91f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:54.053724 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-57f39e22-303b-4c34-ab12-de622375b91f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:54.059491 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-57f39e22-303b-4c34-ab12-de622375b91f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:54.060005 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-57f39e22-303b-4c34-ab12-de622375b91f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:54.060823 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-57f39e22-303b-4c34-ab12-de622375b91f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:54.061260 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-57f39e22-303b-4c34-ab12-de622375b91f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:54.201512 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-57f39e22-303b-4c34-ab12-de622375b91f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:54.209806 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-57f39e22-303b-4c34-ab12-de622375b91f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:54.212342 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-57f39e22-303b-4c34-ab12-de622375b91f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:54.212577 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-57f39e22-303b-4c34-ab12-de622375b91f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1721 microversion: 2.20 time: 0.163166 Nov 23 14:35:54.213133 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 431/864] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:54 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:54.230167 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ef503e71-1eda-4a9f-a9ef-24288be858c9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:54.230856 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ef503e71-1eda-4a9f-a9ef-24288be858c9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] [instance: 43b4442f-25b2-4695-a16f-17263d9e1710] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:54.237333 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ef503e71-1eda-4a9f-a9ef-24288be858c9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:54.237837 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ef503e71-1eda-4a9f-a9ef-24288be858c9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:54.248323 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ef503e71-1eda-4a9f-a9ef-24288be858c9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:54.248323 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ef503e71-1eda-4a9f-a9ef-24288be858c9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:54.251870 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-ef503e71-1eda-4a9f-a9ef-24288be858c9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] HTTP exception thrown: Instance 43b4442f-25b2-4695-a16f-17263d9e1710 could not be found. Nov 23 14:35:54.252471 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ef503e71-1eda-4a9f-a9ef-24288be858c9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] Returning 404 to user: Instance 43b4442f-25b2-4695-a16f-17263d9e1710 could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:35:54.253268 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ef503e71-1eda-4a9f-a9ef-24288be858c9 tempest-AttachVolumeNegativeTest-697971097 tempest-AttachVolumeNegativeTest-697971097-project] 10.222.0.82 "GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710" status: 404 len: 111 microversion: 2.1 time: 0.027799 Nov 23 14:35:54.253787 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 434/865] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:54 2021] GET /compute/v2.1/servers/43b4442f-25b2-4695-a16f-17263d9e1710 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:35:54.828385 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2231a0f9-735f-4e80-aa1b-4a6b80f15347 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:54.828979 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2231a0f9-735f-4e80-aa1b-4a6b80f15347 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:54.834701 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2231a0f9-735f-4e80-aa1b-4a6b80f15347 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:54.835143 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2231a0f9-735f-4e80-aa1b-4a6b80f15347 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:54.835919 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2231a0f9-735f-4e80-aa1b-4a6b80f15347 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:54.836397 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2231a0f9-735f-4e80-aa1b-4a6b80f15347 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:54.920945 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-2231a0f9-735f-4e80-aa1b-4a6b80f15347 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lazy-loading 'services' on Instance uuid 3b1ac082-a980-455a-a956-0e2c15214e47 {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:35:55.173742 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2231a0f9-735f-4e80-aa1b-4a6b80f15347 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "DELETE /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47/os-volume_attachments/6cd361fb-aead-43db-83c5-38bf4bedeba4" status: 202 len: 0 microversion: 2.1 time: 0.349018 Nov 23 14:35:55.174338 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 432/866] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Nov 23 14:35:54 2021] DELETE /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47/os-volume_attachments/6cd361fb-aead-43db-83c5-38bf4bedeba4 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:35:55.231806 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1e79acc7-1e40-42cf-86ab-2190d8906ef1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:55.233101 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1e79acc7-1e40-42cf-86ab-2190d8906ef1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:55.240533 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1e79acc7-1e40-42cf-86ab-2190d8906ef1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:55.241013 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1e79acc7-1e40-42cf-86ab-2190d8906ef1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:55.241796 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1e79acc7-1e40-42cf-86ab-2190d8906ef1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:55.242230 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1e79acc7-1e40-42cf-86ab-2190d8906ef1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:55.502824 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1e79acc7-1e40-42cf-86ab-2190d8906ef1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:55.512395 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1e79acc7-1e40-42cf-86ab-2190d8906ef1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:55.514680 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1e79acc7-1e40-42cf-86ab-2190d8906ef1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:55.516571 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1e79acc7-1e40-42cf-86ab-2190d8906ef1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1664 microversion: 2.20 time: 0.289197 Nov 23 14:35:55.518089 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 435/867] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:55 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1664 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:55.520919 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-2ea6a3b7-cb04-405a-960e-39a90ab60ac3 req-cf2a1b66-c76e-4466-8344-9a7402687c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c8dbd0-2f80-4158-923b-24f263fd9832", "name": "network-vif-unplugged", "status": "completed", "tag": "643c4469-7e07-47b2-806d-0dfc74abe378"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:55.522500 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:35:55.522500 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:35:55.536651 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-2ea6a3b7-cb04-405a-960e-39a90ab60ac3 req-cf2a1b66-c76e-4466-8344-9a7402687c7e service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:55.537835 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f666b395-fbe7-4748-9137-bde961aa2e2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "514f6112-4c3c-43e6-8693-0ef793dc5744"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:55.539373 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f666b395-fbe7-4748-9137-bde961aa2e2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:55.545629 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-2ea6a3b7-cb04-405a-960e-39a90ab60ac3 req-cf2a1b66-c76e-4466-8344-9a7402687c7e service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:55.557778 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f666b395-fbe7-4748-9137-bde961aa2e2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:55.560543 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f666b395-fbe7-4748-9137-bde961aa2e2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:55.562991 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f666b395-fbe7-4748-9137-bde961aa2e2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:55.565070 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f666b395-fbe7-4748-9137-bde961aa2e2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:55.570441 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.compute.server_external_events [req-2ea6a3b7-cb04-405a-960e-39a90ab60ac3 req-cf2a1b66-c76e-4466-8344-9a7402687c7e service nova] Unable to find a host for instance f5c8dbd0-2f80-4158-923b-24f263fd9832. Dropping event network-vif-unplugged {{(pid=116787) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 23 14:35:55.572070 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-2ea6a3b7-cb04-405a-960e-39a90ab60ac3 req-cf2a1b66-c76e-4466-8344-9a7402687c7e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.056153 Nov 23 14:35:55.573494 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 433/868] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:35:55 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 58 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 23 14:35:56.582657 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f666b395-fbe7-4748-9137-bde961aa2e2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.050047 Nov 23 14:35:56.583524 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 436/869] 10.222.0.82 () {62 vars in 1363 bytes} [Tue Nov 23 14:35:55 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-volume_attachments => generated 188 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:35:56.696173 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a6b3d3ac-d656-40d3-9d25-71e4ca9796a0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:56.696894 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a6b3d3ac-d656-40d3-9d25-71e4ca9796a0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:56.703369 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a6b3d3ac-d656-40d3-9d25-71e4ca9796a0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:56.703887 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a6b3d3ac-d656-40d3-9d25-71e4ca9796a0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:56.704683 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a6b3d3ac-d656-40d3-9d25-71e4ca9796a0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:56.705113 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a6b3d3ac-d656-40d3-9d25-71e4ca9796a0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:56.753915 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-97ceafa6-78ba-4cd4-958e-521dab7d5f4a tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Action: 'create', calling method: .version_select at 0x7f2082feb280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1769362830"}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:57.084144 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a6b3d3ac-d656-40d3-9d25-71e4ca9796a0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action" status: 202 len: 0 microversion: 2.20 time: 0.391672 Nov 23 14:35:57.084826 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 437/870] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:35:56 2021] POST /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 23 14:35:57.093149 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d80bdde4-2453-40de-afc6-118de7d89636 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:57.093745 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d80bdde4-2453-40de-afc6-118de7d89636 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:57.102622 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d80bdde4-2453-40de-afc6-118de7d89636 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:57.102622 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d80bdde4-2453-40de-afc6-118de7d89636 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:57.102622 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d80bdde4-2453-40de-afc6-118de7d89636 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:57.102622 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d80bdde4-2453-40de-afc6-118de7d89636 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:57.237608 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d80bdde4-2453-40de-afc6-118de7d89636 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:57.246507 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d80bdde4-2453-40de-afc6-118de7d89636 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:57.248150 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d80bdde4-2453-40de-afc6-118de7d89636 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:57.249324 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d80bdde4-2453-40de-afc6-118de7d89636 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1750 microversion: 2.20 time: 0.160378 Nov 23 14:35:57.249873 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 438/871] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:57 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:35:57.331623 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a743d07e-4f6d-4383-81bd-157d4f72d15b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:57.332121 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a743d07e-4f6d-4383-81bd-157d4f72d15b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:57.338185 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a743d07e-4f6d-4383-81bd-157d4f72d15b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:57.338670 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a743d07e-4f6d-4383-81bd-157d4f72d15b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:57.339423 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a743d07e-4f6d-4383-81bd-157d4f72d15b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:57.339859 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a743d07e-4f6d-4383-81bd-157d4f72d15b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:57.365275 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a743d07e-4f6d-4383-81bd-157d4f72d15b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Going to try to terminate instance {{(pid=116788) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:35:57.479741 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-97ceafa6-78ba-4cd4-958e-521dab7d5f4a tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.837799 Nov 23 14:35:57.480383 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 434/872] 10.222.0.82 () {60 vars in 1154 bytes} [Tue Nov 23 14:35:56 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 839 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 23 14:35:57.491512 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-17c2cd7d-9117-4328-81a8-82394d2adb38 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f208805b430>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:57.538447 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-17c2cd7d-9117-4328-81a8-82394d2adb38 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/8c471545-d59c-4b7d-a2d2-a28becbfdc32" status: 200 len: 345 microversion: 2.1 time: 0.050280 Nov 23 14:35:57.539056 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 435/873] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Nov 23 14:35:57 2021] GET /compute/v2.1/os-volumes/8c471545-d59c-4b7d-a2d2-a28becbfdc32 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:35:57.680419 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a743d07e-4f6d-4383-81bd-157d4f72d15b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "DELETE /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 204 len: 0 microversion: 2.1 time: 0.352038 Nov 23 14:35:57.683294 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 439/874] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:35:57 2021] DELETE /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 14:35:57.689743 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1383ea07-a4a1-4b9e-a586-3599c67283df tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:57.690470 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1383ea07-a4a1-4b9e-a586-3599c67283df tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:57.697887 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1383ea07-a4a1-4b9e-a586-3599c67283df tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:57.698331 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1383ea07-a4a1-4b9e-a586-3599c67283df tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:57.699162 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1383ea07-a4a1-4b9e-a586-3599c67283df tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:57.699571 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1383ea07-a4a1-4b9e-a586-3599c67283df tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:57.837359 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-1383ea07-a4a1-4b9e-a586-3599c67283df tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:57.845333 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1383ea07-a4a1-4b9e-a586-3599c67283df tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1512 microversion: 2.1 time: 0.159955 Nov 23 14:35:57.846212 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 436/875] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:57 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:35:58.269408 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-78671176-1486-4f5c-94ad-b0c40265496d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:58.270101 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-78671176-1486-4f5c-94ad-b0c40265496d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:58.276817 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-78671176-1486-4f5c-94ad-b0c40265496d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:58.277266 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-78671176-1486-4f5c-94ad-b0c40265496d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:58.278141 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-78671176-1486-4f5c-94ad-b0c40265496d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:58.278657 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-78671176-1486-4f5c-94ad-b0c40265496d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:58.426382 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-78671176-1486-4f5c-94ad-b0c40265496d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:58.434834 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-78671176-1486-4f5c-94ad-b0c40265496d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:58.437016 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-78671176-1486-4f5c-94ad-b0c40265496d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:58.438239 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-78671176-1486-4f5c-94ad-b0c40265496d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1750 microversion: 2.20 time: 0.173560 Nov 23 14:35:58.444447 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 440/876] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:58 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:35:58.551620 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e64e3be3-0db8-412b-8ebb-1cd1d54c27bc tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f208805bca0>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:58.598757 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e64e3be3-0db8-412b-8ebb-1cd1d54c27bc tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/8c471545-d59c-4b7d-a2d2-a28becbfdc32" status: 200 len: 346 microversion: 2.1 time: 0.050868 Nov 23 14:35:58.599323 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 437/877] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Nov 23 14:35:58 2021] GET /compute/v2.1/os-volumes/8c471545-d59c-4b7d-a2d2-a28becbfdc32 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:58.610316 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d3eb19fa-8e6d-4faa-8cdd-0a1d5b7a834f tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Action: 'create', calling method: .version_select at 0x7f2082716dc0>, body: {"snapshot": {"volume_id": "8c471545-d59c-4b7d-a2d2-a28becbfdc32", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1829147561"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:35:58.863450 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c1c29398-1b52-473b-a4bd-e5166e5ef345 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:58.864325 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c1c29398-1b52-473b-a4bd-e5166e5ef345 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:58.871793 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c1c29398-1b52-473b-a4bd-e5166e5ef345 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:58.874211 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c1c29398-1b52-473b-a4bd-e5166e5ef345 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:58.875048 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c1c29398-1b52-473b-a4bd-e5166e5ef345 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:58.875484 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c1c29398-1b52-473b-a4bd-e5166e5ef345 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:58.992690 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d3eb19fa-8e6d-4faa-8cdd-0a1d5b7a834f tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.386072 Nov 23 14:35:58.997310 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 441/878] 10.222.0.82 () {60 vars in 1161 bytes} [Tue Nov 23 14:35:58 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:59.003525 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a4a75208-d3f4-4fbd-8e99-249fce2d16f5 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f2082777670>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:59.032904 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c1c29398-1b52-473b-a4bd-e5166e5ef345 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:59.034613 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a4a75208-d3f4-4fbd-8e99-249fce2d16f5 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0" status: 200 len: 287 microversion: 2.1 time: 0.035403 Nov 23 14:35:59.035186 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 442/879] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Nov 23 14:35:58 2021] GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:59.040572 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c1c29398-1b52-473b-a4bd-e5166e5ef345 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1512 microversion: 2.1 time: 0.181135 Nov 23 14:35:59.041132 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 438/880] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:35:58 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:35:59.045217 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-83df3b7a-434e-478a-8f31-8dfe45487201 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f20826e29d0>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:59.073113 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-83df3b7a-434e-478a-8f31-8dfe45487201 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032052 Nov 23 14:35:59.073685 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 443/881] 10.222.0.82 () {58 vars in 1139 bytes} [Tue Nov 23 14:35:59 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:35:59.089602 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-bf3c38d0-39c2-4758-abcf-7e6f6d58552e tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f2088061af0>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:59.119832 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-bf3c38d0-39c2-4758-abcf-7e6f6d58552e tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0" status: 200 len: 287 microversion: 2.1 time: 0.033846 Nov 23 14:35:59.120619 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 439/882] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Nov 23 14:35:59 2021] GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:35:59.457772 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-36f24b0c-1498-4989-9e4a-1a0c337904d9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:35:59.458373 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-36f24b0c-1498-4989-9e4a-1a0c337904d9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:35:59.464309 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-36f24b0c-1498-4989-9e4a-1a0c337904d9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:59.464758 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-36f24b0c-1498-4989-9e4a-1a0c337904d9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:59.465528 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-36f24b0c-1498-4989-9e4a-1a0c337904d9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:35:59.465959 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-36f24b0c-1498-4989-9e4a-1a0c337904d9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:35:59.594850 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-36f24b0c-1498-4989-9e4a-1a0c337904d9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:59.603186 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-36f24b0c-1498-4989-9e4a-1a0c337904d9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:59.604705 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-36f24b0c-1498-4989-9e4a-1a0c337904d9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:35:59.605847 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-36f24b0c-1498-4989-9e4a-1a0c337904d9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1752 microversion: 2.20 time: 0.152363 Nov 23 14:35:59.606417 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 444/883] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:35:59 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:00.058758 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9155f87d-acd0-44d7-a2bc-9f9a01f81310 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:00.059366 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9155f87d-acd0-44d7-a2bc-9f9a01f81310 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:00.065964 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9155f87d-acd0-44d7-a2bc-9f9a01f81310 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:00.066415 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9155f87d-acd0-44d7-a2bc-9f9a01f81310 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:00.067220 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9155f87d-acd0-44d7-a2bc-9f9a01f81310 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:00.067656 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9155f87d-acd0-44d7-a2bc-9f9a01f81310 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:00.130610 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-edfbb0cc-afea-40ed-b190-aa253e6c84ff tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f2082716b80>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:00.160880 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-edfbb0cc-afea-40ed-b190-aa253e6c84ff tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0" status: 200 len: 287 microversion: 2.1 time: 0.033756 Nov 23 14:36:00.161458 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 445/884] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Nov 23 14:36:00 2021] GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:36:00.197001 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9155f87d-acd0-44d7-a2bc-9f9a01f81310 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:00.204270 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9155f87d-acd0-44d7-a2bc-9f9a01f81310 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1512 microversion: 2.1 time: 0.149606 Nov 23 14:36:00.204826 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 440/885] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:36:00 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:36:00.625566 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f5e31663-266e-4bc7-a01f-f83f758d4640 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:00.626086 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f5e31663-266e-4bc7-a01f-f83f758d4640 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:00.631999 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f5e31663-266e-4bc7-a01f-f83f758d4640 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:00.632478 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f5e31663-266e-4bc7-a01f-f83f758d4640 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:00.633251 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f5e31663-266e-4bc7-a01f-f83f758d4640 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:00.633715 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f5e31663-266e-4bc7-a01f-f83f758d4640 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:00.763644 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-f5e31663-266e-4bc7-a01f-f83f758d4640 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:00.771849 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-f5e31663-266e-4bc7-a01f-f83f758d4640 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:00.773391 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-f5e31663-266e-4bc7-a01f-f83f758d4640 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:00.774791 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f5e31663-266e-4bc7-a01f-f83f758d4640 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1752 microversion: 2.20 time: 0.153420 Nov 23 14:36:00.775352 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 446/886] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:00 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:01.172903 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-55c12ffa-59f5-437e-97a2-5bea5ab24c14 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f208805b430>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:01.201726 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-55c12ffa-59f5-437e-97a2-5bea5ab24c14 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0" status: 200 len: 287 microversion: 2.1 time: 0.033111 Nov 23 14:36:01.202275 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 441/887] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Nov 23 14:36:01 2021] GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:36:01.220976 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9b1c9ed8-6949-4be4-8b4d-d75e3be99989 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:01.221573 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9b1c9ed8-6949-4be4-8b4d-d75e3be99989 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:01.227304 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9b1c9ed8-6949-4be4-8b4d-d75e3be99989 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:01.227740 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9b1c9ed8-6949-4be4-8b4d-d75e3be99989 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:01.228527 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9b1c9ed8-6949-4be4-8b4d-d75e3be99989 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:01.228956 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9b1c9ed8-6949-4be4-8b4d-d75e3be99989 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:01.355181 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9b1c9ed8-6949-4be4-8b4d-d75e3be99989 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:01.362957 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9b1c9ed8-6949-4be4-8b4d-d75e3be99989 tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1512 microversion: 2.1 time: 0.145556 Nov 23 14:36:01.363818 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 447/888] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:36:01 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:36:01.793335 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2853d01f-e57d-497f-8ad6-c12b71aa9cfe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:01.794543 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2853d01f-e57d-497f-8ad6-c12b71aa9cfe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:01.800425 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2853d01f-e57d-497f-8ad6-c12b71aa9cfe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:01.800871 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2853d01f-e57d-497f-8ad6-c12b71aa9cfe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:01.801630 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2853d01f-e57d-497f-8ad6-c12b71aa9cfe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:01.802056 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2853d01f-e57d-497f-8ad6-c12b71aa9cfe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:01.931042 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2853d01f-e57d-497f-8ad6-c12b71aa9cfe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:01.939997 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2853d01f-e57d-497f-8ad6-c12b71aa9cfe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:01.941520 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2853d01f-e57d-497f-8ad6-c12b71aa9cfe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:01.942661 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2853d01f-e57d-497f-8ad6-c12b71aa9cfe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1752 microversion: 2.20 time: 0.153068 Nov 23 14:36:01.943212 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 442/889] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:01 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:02.213020 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-de52260f-86be-43d2-baee-f5ce25a455c8 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f208802cc10>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:02.242254 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-de52260f-86be-43d2-baee-f5ce25a455c8 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0" status: 200 len: 287 microversion: 2.1 time: 0.032745 Nov 23 14:36:02.242906 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 448/890] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Nov 23 14:36:02 2021] GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:36:02.380482 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-45bc540f-446f-4c95-a9d4-cb57ed1dff5b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:02.381094 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-45bc540f-446f-4c95-a9d4-cb57ed1dff5b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:02.387432 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45bc540f-446f-4c95-a9d4-cb57ed1dff5b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:02.387878 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45bc540f-446f-4c95-a9d4-cb57ed1dff5b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:02.389213 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45bc540f-446f-4c95-a9d4-cb57ed1dff5b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:02.389650 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45bc540f-446f-4c95-a9d4-cb57ed1dff5b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:02.517898 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-45bc540f-446f-4c95-a9d4-cb57ed1dff5b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:02.525456 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-45bc540f-446f-4c95-a9d4-cb57ed1dff5b tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1512 microversion: 2.1 time: 0.148712 Nov 23 14:36:02.526010 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 443/891] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:36:02 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:36:02.960788 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9d939e30-97ef-4741-a60a-5bae2c3f5f7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:02.961407 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9d939e30-97ef-4741-a60a-5bae2c3f5f7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:02.967281 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9d939e30-97ef-4741-a60a-5bae2c3f5f7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:02.967722 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9d939e30-97ef-4741-a60a-5bae2c3f5f7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:02.968510 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9d939e30-97ef-4741-a60a-5bae2c3f5f7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:02.968945 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9d939e30-97ef-4741-a60a-5bae2c3f5f7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:03.096866 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9d939e30-97ef-4741-a60a-5bae2c3f5f7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:03.104918 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9d939e30-97ef-4741-a60a-5bae2c3f5f7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:03.106385 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9d939e30-97ef-4741-a60a-5bae2c3f5f7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:03.107654 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9d939e30-97ef-4741-a60a-5bae2c3f5f7e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1752 microversion: 2.20 time: 0.150550 Nov 23 14:36:03.108213 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 449/892] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:02 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:03.263055 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-257b53a2-b83e-4335-bec1-4d8817342219 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f2082fabca0>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:03.292742 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-257b53a2-b83e-4335-bec1-4d8817342219 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0" status: 200 len: 287 microversion: 2.1 time: 0.033063 Nov 23 14:36:03.293161 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 444/893] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Nov 23 14:36:03 2021] GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:36:03.542476 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3f12f479-c7f7-4d27-b93a-0d3f6318d3fa tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:03.543105 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3f12f479-c7f7-4d27-b93a-0d3f6318d3fa tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:03.549609 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3f12f479-c7f7-4d27-b93a-0d3f6318d3fa tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:03.550059 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3f12f479-c7f7-4d27-b93a-0d3f6318d3fa tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:03.550840 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3f12f479-c7f7-4d27-b93a-0d3f6318d3fa tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:03.551278 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3f12f479-c7f7-4d27-b93a-0d3f6318d3fa tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:03.684067 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-3f12f479-c7f7-4d27-b93a-0d3f6318d3fa tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:03.692439 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3f12f479-c7f7-4d27-b93a-0d3f6318d3fa tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1512 microversion: 2.1 time: 0.153514 Nov 23 14:36:03.693023 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 450/894] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:36:03 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:36:04.126063 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6eab7beb-6b4d-4c5e-b803-37096d9d0932 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:04.126755 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6eab7beb-6b4d-4c5e-b803-37096d9d0932 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:04.132770 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6eab7beb-6b4d-4c5e-b803-37096d9d0932 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:04.133220 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6eab7beb-6b4d-4c5e-b803-37096d9d0932 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:04.134209 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6eab7beb-6b4d-4c5e-b803-37096d9d0932 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:04.134874 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6eab7beb-6b4d-4c5e-b803-37096d9d0932 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:04.244888 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-fdcd215c-b992-4c04-aeb8-d1e9aaf0e03c req-ab6a832b-431c-4f35-aa22-76d25414a212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1ac082-a980-455a-a956-0e2c15214e47", "name": "network-vif-deleted", "tag": "e6f176df-d717-49b9-b93b-6866d8771953"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:36:04.246976 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:36:04.246976 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:36:04.255917 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-fdcd215c-b992-4c04-aeb8-d1e9aaf0e03c req-ab6a832b-431c-4f35-aa22-76d25414a212 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:04.256420 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-fdcd215c-b992-4c04-aeb8-d1e9aaf0e03c req-ab6a832b-431c-4f35-aa22-76d25414a212 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:04.269260 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-fdcd215c-b992-4c04-aeb8-d1e9aaf0e03c req-ab6a832b-431c-4f35-aa22-76d25414a212 service nova] Creating event network-vif-deleted:e6f176df-d717-49b9-b93b-6866d8771953 for instance 3b1ac082-a980-455a-a956-0e2c15214e47 on hv-cinder-80475 Nov 23 14:36:04.274459 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-fdcd215c-b992-4c04-aeb8-d1e9aaf0e03c req-ab6a832b-431c-4f35-aa22-76d25414a212 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033352 Nov 23 14:36:04.275244 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 451/895] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:36:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:36:04.305225 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ef9b5f45-c176-49b4-b352-59a62eb4f940 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f20880caa60>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:04.327786 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6eab7beb-6b4d-4c5e-b803-37096d9d0932 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:04.336274 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6eab7beb-6b4d-4c5e-b803-37096d9d0932 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:04.336410 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ef9b5f45-c176-49b4-b352-59a62eb4f940 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0" status: 200 len: 288 microversion: 2.1 time: 0.035604 Nov 23 14:36:04.336866 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 452/896] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Nov 23 14:36:04 2021] GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0 => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:36:04.337996 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6eab7beb-6b4d-4c5e-b803-37096d9d0932 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:04.339367 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6eab7beb-6b4d-4c5e-b803-37096d9d0932 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1752 microversion: 2.20 time: 0.218282 Nov 23 14:36:04.339916 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 445/897] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:04 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:04.346980 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d5c6b64a-d5bc-4aed-81da-a96f114e1777 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f20826c5a60>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:04.458426 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d5c6b64a-d5bc-4aed-81da-a96f114e1777 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "DELETE /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0" status: 202 len: 0 microversion: 2.1 time: 0.114829 Nov 23 14:36:04.459002 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 453/898] 10.222.0.82 () {58 vars in 1253 bytes} [Tue Nov 23 14:36:04 2021] DELETE /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:36:04.467413 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9dcbedec-ef4e-4dde-bebe-eb8488e3e805 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f2082fab8b0>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:04.496053 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9dcbedec-ef4e-4dde-bebe-eb8488e3e805 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0" status: 200 len: 287 microversion: 2.1 time: 0.032653 Nov 23 14:36:04.496648 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 446/899] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Nov 23 14:36:04 2021] GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:36:04.709936 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-86905142-6d54-4af4-81ec-b113ba0c891c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:04.710664 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-86905142-6d54-4af4-81ec-b113ba0c891c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:04.717800 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-86905142-6d54-4af4-81ec-b113ba0c891c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:04.718245 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-86905142-6d54-4af4-81ec-b113ba0c891c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:04.719015 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-86905142-6d54-4af4-81ec-b113ba0c891c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:04.719442 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-86905142-6d54-4af4-81ec-b113ba0c891c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:04.748140 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-86905142-6d54-4af4-81ec-b113ba0c891c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:04.748612 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-86905142-6d54-4af4-81ec-b113ba0c891c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:04.749057 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.objects.instance [None req-86905142-6d54-4af4-81ec-b113ba0c891c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lazy-loading 'fault' on Instance uuid 3b1ac082-a980-455a-a956-0e2c15214e47 {{(pid=116788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:36:04.789450 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-86905142-6d54-4af4-81ec-b113ba0c891c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab6b03dcab74efd8ed186b0330a5555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374651ab7b774bf6b1d6c8ac7a94bdb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:04.797028 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-86905142-6d54-4af4-81ec-b113ba0c891c tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 200 len: 1308 microversion: 2.1 time: 0.091168 Nov 23 14:36:04.797599 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 454/900] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:36:04 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:36:05.360176 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-fc7f4063-ede3-473a-beae-08fdfa5d4a17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:05.360921 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-fc7f4063-ede3-473a-beae-08fdfa5d4a17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:05.371858 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc7f4063-ede3-473a-beae-08fdfa5d4a17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:05.372964 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc7f4063-ede3-473a-beae-08fdfa5d4a17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:05.373862 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc7f4063-ede3-473a-beae-08fdfa5d4a17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:05.375309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fc7f4063-ede3-473a-beae-08fdfa5d4a17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:05.507141 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-464f04f6-8b7a-434b-9615-9f2871677860 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f20826c5310>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:05.533980 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-464f04f6-8b7a-434b-9615-9f2871677860 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] HTTP exception thrown: Snapshot b567b368-d74a-4705-8416-cdc084797da0 could not be found. Nov 23 14:36:05.534749 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-464f04f6-8b7a-434b-9615-9f2871677860 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Returning 404 to user: Snapshot b567b368-d74a-4705-8416-cdc084797da0 could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:36:05.535791 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-464f04f6-8b7a-434b-9615-9f2871677860 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0" status: 404 len: 111 microversion: 2.1 time: 0.032390 Nov 23 14:36:05.536559 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 455/901] 10.222.0.82 () {58 vars in 1250 bytes} [Tue Nov 23 14:36:05 2021] GET /compute/v2.1/os-snapshots/b567b368-d74a-4705-8416-cdc084797da0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 14:36:05.545194 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-642a965f-e2d8-49f4-8d27-2fff063b1b87 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f20826e2e50>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:05.588812 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-fc7f4063-ede3-473a-beae-08fdfa5d4a17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:05.597614 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-fc7f4063-ede3-473a-beae-08fdfa5d4a17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:05.599106 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-fc7f4063-ede3-473a-beae-08fdfa5d4a17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:05.600352 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-fc7f4063-ede3-473a-beae-08fdfa5d4a17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.245354 Nov 23 14:36:05.603015 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 447/902] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:05 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:05.776937 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-642a965f-e2d8-49f4-8d27-2fff063b1b87 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/8c471545-d59c-4b7d-a2d2-a28becbfdc32" status: 202 len: 0 microversion: 2.1 time: 0.235819 Nov 23 14:36:05.780994 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 456/903] 10.222.0.82 () {58 vars in 1247 bytes} [Tue Nov 23 14:36:05 2021] DELETE /compute/v2.1/os-volumes/8c471545-d59c-4b7d-a2d2-a28becbfdc32 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:36:05.787204 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5c2233ef-3646-453c-8319-8c562f9047c9 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f2082fabf70>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:05.813962 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-886632f9-296b-4126-8c62-5112d4b311cf tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:05.814675 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-886632f9-296b-4126-8c62-5112d4b311cf tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] [instance: 3b1ac082-a980-455a-a956-0e2c15214e47] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:05.821166 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-886632f9-296b-4126-8c62-5112d4b311cf tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:05.821611 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-886632f9-296b-4126-8c62-5112d4b311cf tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:05.822585 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-886632f9-296b-4126-8c62-5112d4b311cf tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:05.823042 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-886632f9-296b-4126-8c62-5112d4b311cf tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:05.835937 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5c2233ef-3646-453c-8319-8c562f9047c9 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/8c471545-d59c-4b7d-a2d2-a28becbfdc32" status: 200 len: 345 microversion: 2.1 time: 0.052356 Nov 23 14:36:05.836544 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 448/904] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Nov 23 14:36:05 2021] GET /compute/v2.1/os-volumes/8c471545-d59c-4b7d-a2d2-a28becbfdc32 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:36:05.841538 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-886632f9-296b-4126-8c62-5112d4b311cf tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] HTTP exception thrown: Instance 3b1ac082-a980-455a-a956-0e2c15214e47 could not be found. Nov 23 14:36:05.841538 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-886632f9-296b-4126-8c62-5112d4b311cf tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] Returning 404 to user: Instance 3b1ac082-a980-455a-a956-0e2c15214e47 could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:36:05.841538 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-886632f9-296b-4126-8c62-5112d4b311cf tempest-VolumesSnapshotTestJSON-762249819 tempest-VolumesSnapshotTestJSON-762249819-project] 10.222.0.82 "GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47" status: 404 len: 111 microversion: 2.1 time: 0.030611 Nov 23 14:36:05.844964 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 457/905] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:36:05 2021] GET /compute/v2.1/servers/3b1ac082-a980-455a-a956-0e2c15214e47 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 14:36:06.619378 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-605c0176-487f-439d-bcd5-c7b1724bb97c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:06.620055 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-605c0176-487f-439d-bcd5-c7b1724bb97c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:06.626616 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-605c0176-487f-439d-bcd5-c7b1724bb97c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:06.627066 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-605c0176-487f-439d-bcd5-c7b1724bb97c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:06.627850 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-605c0176-487f-439d-bcd5-c7b1724bb97c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:06.628318 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-605c0176-487f-439d-bcd5-c7b1724bb97c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:06.770957 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-605c0176-487f-439d-bcd5-c7b1724bb97c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:06.780698 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-605c0176-487f-439d-bcd5-c7b1724bb97c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:06.782212 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-605c0176-487f-439d-bcd5-c7b1724bb97c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:06.783379 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-605c0176-487f-439d-bcd5-c7b1724bb97c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.168382 Nov 23 14:36:06.783934 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 449/906] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:06 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:06.848471 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e19ec749-6aaf-4263-9eea-d222d6a6d822 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f2082716ee0>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:06.877846 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-e19ec749-6aaf-4263-9eea-d222d6a6d822 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] HTTP exception thrown: Volume 8c471545-d59c-4b7d-a2d2-a28becbfdc32 could not be found. Nov 23 14:36:06.878448 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e19ec749-6aaf-4263-9eea-d222d6a6d822 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Returning 404 to user: Volume 8c471545-d59c-4b7d-a2d2-a28becbfdc32 could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:36:06.879272 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e19ec749-6aaf-4263-9eea-d222d6a6d822 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/8c471545-d59c-4b7d-a2d2-a28becbfdc32" status: 404 len: 109 microversion: 2.1 time: 0.034544 Nov 23 14:36:06.879818 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 458/907] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Nov 23 14:36:06 2021] GET /compute/v2.1/os-volumes/8c471545-d59c-4b7d-a2d2-a28becbfdc32 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:36:06.893449 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-cf3edc5a-97ba-4811-8036-379892b2719a tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f2082fabdc0>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:06.923171 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-cf3edc5a-97ba-4811-8036-379892b2719a tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] HTTP exception thrown: Volume 8c471545-d59c-4b7d-a2d2-a28becbfdc32 could not be found. Nov 23 14:36:06.923935 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-cf3edc5a-97ba-4811-8036-379892b2719a tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Returning 404 to user: Volume 8c471545-d59c-4b7d-a2d2-a28becbfdc32 could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:36:06.924969 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-cf3edc5a-97ba-4811-8036-379892b2719a tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/8c471545-d59c-4b7d-a2d2-a28becbfdc32" status: 404 len: 109 microversion: 2.1 time: 0.035130 Nov 23 14:36:06.925574 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 450/908] 10.222.0.82 () {58 vars in 1247 bytes} [Tue Nov 23 14:36:06 2021] DELETE /compute/v2.1/os-volumes/8c471545-d59c-4b7d-a2d2-a28becbfdc32 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:36:06.934299 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ba75c9d2-5b0e-4b78-94ad-90daef6dd354 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Calling method '.version_select at 0x7f20882bc8b0>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:06.961998 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-ba75c9d2-5b0e-4b78-94ad-90daef6dd354 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] HTTP exception thrown: Volume 8c471545-d59c-4b7d-a2d2-a28becbfdc32 could not be found. Nov 23 14:36:06.962606 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ba75c9d2-5b0e-4b78-94ad-90daef6dd354 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] Returning 404 to user: Volume 8c471545-d59c-4b7d-a2d2-a28becbfdc32 could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:36:06.963435 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ba75c9d2-5b0e-4b78-94ad-90daef6dd354 tempest-VolumesSnapshotsTestJSON-863626330 tempest-VolumesSnapshotsTestJSON-863626330-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/8c471545-d59c-4b7d-a2d2-a28becbfdc32" status: 404 len: 109 microversion: 2.1 time: 0.033587 Nov 23 14:36:06.963987 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 459/909] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Nov 23 14:36:06 2021] GET /compute/v2.1/os-volumes/8c471545-d59c-4b7d-a2d2-a28becbfdc32 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:36:07.803919 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-694cbd5a-b2b8-4ed6-b0e9-a002deaa4689 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:07.804571 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-694cbd5a-b2b8-4ed6-b0e9-a002deaa4689 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:07.814665 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-694cbd5a-b2b8-4ed6-b0e9-a002deaa4689 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:07.814665 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-694cbd5a-b2b8-4ed6-b0e9-a002deaa4689 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:07.814665 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-694cbd5a-b2b8-4ed6-b0e9-a002deaa4689 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:07.814665 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-694cbd5a-b2b8-4ed6-b0e9-a002deaa4689 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:08.016502 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-694cbd5a-b2b8-4ed6-b0e9-a002deaa4689 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:08.027664 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-694cbd5a-b2b8-4ed6-b0e9-a002deaa4689 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:08.029513 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-694cbd5a-b2b8-4ed6-b0e9-a002deaa4689 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:08.031860 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-694cbd5a-b2b8-4ed6-b0e9-a002deaa4689 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.231302 Nov 23 14:36:08.031860 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 451/910] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:07 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:36:09.051974 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-920ea7ba-41f9-4b6c-ac46-2e866fb3f4ba tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:09.054033 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-920ea7ba-41f9-4b6c-ac46-2e866fb3f4ba tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:09.060811 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-920ea7ba-41f9-4b6c-ac46-2e866fb3f4ba tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:09.061680 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-920ea7ba-41f9-4b6c-ac46-2e866fb3f4ba tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:09.062633 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-920ea7ba-41f9-4b6c-ac46-2e866fb3f4ba tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:09.063405 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-920ea7ba-41f9-4b6c-ac46-2e866fb3f4ba tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:09.230178 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-920ea7ba-41f9-4b6c-ac46-2e866fb3f4ba tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:09.239183 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-920ea7ba-41f9-4b6c-ac46-2e866fb3f4ba tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:09.240739 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-920ea7ba-41f9-4b6c-ac46-2e866fb3f4ba tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:09.241891 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-920ea7ba-41f9-4b6c-ac46-2e866fb3f4ba tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.194407 Nov 23 14:36:09.243086 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 460/911] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:09 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:10.260835 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8f709cb4-4fcd-4a47-9c8e-84b06455c755 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:10.261441 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8f709cb4-4fcd-4a47-9c8e-84b06455c755 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:10.267699 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8f709cb4-4fcd-4a47-9c8e-84b06455c755 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:10.268152 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8f709cb4-4fcd-4a47-9c8e-84b06455c755 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:10.268971 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8f709cb4-4fcd-4a47-9c8e-84b06455c755 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:10.269414 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8f709cb4-4fcd-4a47-9c8e-84b06455c755 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:10.429069 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-8f709cb4-4fcd-4a47-9c8e-84b06455c755 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:10.435963 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-8f709cb4-4fcd-4a47-9c8e-84b06455c755 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:10.437611 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-8f709cb4-4fcd-4a47-9c8e-84b06455c755 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:10.438760 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8f709cb4-4fcd-4a47-9c8e-84b06455c755 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.181656 Nov 23 14:36:10.439318 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 452/912] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:10 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:11.457037 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-38292bd8-c2fb-49fd-82b4-5d170a8e73bc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:11.457631 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-38292bd8-c2fb-49fd-82b4-5d170a8e73bc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:11.467465 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-38292bd8-c2fb-49fd-82b4-5d170a8e73bc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:11.467908 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-38292bd8-c2fb-49fd-82b4-5d170a8e73bc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:11.468976 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-38292bd8-c2fb-49fd-82b4-5d170a8e73bc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:11.470603 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-38292bd8-c2fb-49fd-82b4-5d170a8e73bc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:11.612378 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-38292bd8-c2fb-49fd-82b4-5d170a8e73bc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:11.621163 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-38292bd8-c2fb-49fd-82b4-5d170a8e73bc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:11.623937 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-38292bd8-c2fb-49fd-82b4-5d170a8e73bc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:11.625325 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-38292bd8-c2fb-49fd-82b4-5d170a8e73bc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.172220 Nov 23 14:36:11.626491 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 461/913] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:11 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:12.643738 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c9371804-a436-4e16-8c1d-36596faafc30 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:12.646542 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c9371804-a436-4e16-8c1d-36596faafc30 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:12.650785 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c9371804-a436-4e16-8c1d-36596faafc30 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:12.651236 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c9371804-a436-4e16-8c1d-36596faafc30 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:12.652006 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c9371804-a436-4e16-8c1d-36596faafc30 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:12.652957 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c9371804-a436-4e16-8c1d-36596faafc30 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:12.804533 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c9371804-a436-4e16-8c1d-36596faafc30 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:12.813937 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c9371804-a436-4e16-8c1d-36596faafc30 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:12.820208 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c9371804-a436-4e16-8c1d-36596faafc30 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:12.823342 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c9371804-a436-4e16-8c1d-36596faafc30 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.183286 Nov 23 14:36:12.823892 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 453/914] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:12 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:13.842788 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c474c5f0-23e9-4a98-a1c9-cf5060acd037 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:13.843419 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c474c5f0-23e9-4a98-a1c9-cf5060acd037 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:13.849644 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c474c5f0-23e9-4a98-a1c9-cf5060acd037 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:13.850090 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c474c5f0-23e9-4a98-a1c9-cf5060acd037 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:13.850864 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c474c5f0-23e9-4a98-a1c9-cf5060acd037 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:13.851296 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c474c5f0-23e9-4a98-a1c9-cf5060acd037 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:13.992155 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c474c5f0-23e9-4a98-a1c9-cf5060acd037 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:14.001528 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c474c5f0-23e9-4a98-a1c9-cf5060acd037 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:14.003011 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c474c5f0-23e9-4a98-a1c9-cf5060acd037 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:14.004178 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c474c5f0-23e9-4a98-a1c9-cf5060acd037 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.165824 Nov 23 14:36:14.004765 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 462/915] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:13 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:15.022942 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f32afe17-696b-4c48-9fcb-7eaf7905f717 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:15.023542 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f32afe17-696b-4c48-9fcb-7eaf7905f717 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:15.030606 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f32afe17-696b-4c48-9fcb-7eaf7905f717 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:15.031052 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f32afe17-696b-4c48-9fcb-7eaf7905f717 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:15.031819 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f32afe17-696b-4c48-9fcb-7eaf7905f717 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:15.032261 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f32afe17-696b-4c48-9fcb-7eaf7905f717 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:15.161131 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f32afe17-696b-4c48-9fcb-7eaf7905f717 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:15.169502 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f32afe17-696b-4c48-9fcb-7eaf7905f717 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:15.171180 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f32afe17-696b-4c48-9fcb-7eaf7905f717 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:15.172362 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f32afe17-696b-4c48-9fcb-7eaf7905f717 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.153342 Nov 23 14:36:15.172914 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 454/916] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:15 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:16.190645 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9ab19b71-f733-4df5-b48b-10894a3fcbf6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:16.191259 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9ab19b71-f733-4df5-b48b-10894a3fcbf6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:16.197093 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9ab19b71-f733-4df5-b48b-10894a3fcbf6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:16.197536 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9ab19b71-f733-4df5-b48b-10894a3fcbf6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:16.198307 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9ab19b71-f733-4df5-b48b-10894a3fcbf6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:16.198739 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9ab19b71-f733-4df5-b48b-10894a3fcbf6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:16.349941 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9ab19b71-f733-4df5-b48b-10894a3fcbf6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:16.359547 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9ab19b71-f733-4df5-b48b-10894a3fcbf6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:16.361796 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9ab19b71-f733-4df5-b48b-10894a3fcbf6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:16.367705 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9ab19b71-f733-4df5-b48b-10894a3fcbf6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.176537 Nov 23 14:36:16.367705 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 463/917] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:16 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:36:17.382352 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3b49f097-3ed2-467d-9931-f856ceec7d34 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:17.382879 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3b49f097-3ed2-467d-9931-f856ceec7d34 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:17.389951 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3b49f097-3ed2-467d-9931-f856ceec7d34 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:17.390399 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3b49f097-3ed2-467d-9931-f856ceec7d34 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:17.391184 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3b49f097-3ed2-467d-9931-f856ceec7d34 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:17.391795 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3b49f097-3ed2-467d-9931-f856ceec7d34 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:17.531634 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3b49f097-3ed2-467d-9931-f856ceec7d34 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:17.540433 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3b49f097-3ed2-467d-9931-f856ceec7d34 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:17.547144 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3b49f097-3ed2-467d-9931-f856ceec7d34 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:17.547144 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3b49f097-3ed2-467d-9931-f856ceec7d34 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.164669 Nov 23 14:36:17.547144 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 455/918] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:17 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:18.564465 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-92d56fb6-7023-4070-8dcc-2cefef7b74dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:18.565121 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-92d56fb6-7023-4070-8dcc-2cefef7b74dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:18.571194 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-92d56fb6-7023-4070-8dcc-2cefef7b74dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:18.571640 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-92d56fb6-7023-4070-8dcc-2cefef7b74dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:18.572433 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-92d56fb6-7023-4070-8dcc-2cefef7b74dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:18.572864 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-92d56fb6-7023-4070-8dcc-2cefef7b74dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:18.711569 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-92d56fb6-7023-4070-8dcc-2cefef7b74dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:18.720664 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-92d56fb6-7023-4070-8dcc-2cefef7b74dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:18.722156 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-92d56fb6-7023-4070-8dcc-2cefef7b74dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:18.723305 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-92d56fb6-7023-4070-8dcc-2cefef7b74dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.163841 Nov 23 14:36:18.724033 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 464/919] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:18 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:19.742111 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1ad56f95-e9a9-4da9-8695-6b07e6392294 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:19.742799 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1ad56f95-e9a9-4da9-8695-6b07e6392294 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:19.749728 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1ad56f95-e9a9-4da9-8695-6b07e6392294 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:19.750112 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1ad56f95-e9a9-4da9-8695-6b07e6392294 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:19.750995 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1ad56f95-e9a9-4da9-8695-6b07e6392294 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:19.751355 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1ad56f95-e9a9-4da9-8695-6b07e6392294 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:19.896660 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-1ad56f95-e9a9-4da9-8695-6b07e6392294 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:19.905657 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-1ad56f95-e9a9-4da9-8695-6b07e6392294 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:19.907142 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-1ad56f95-e9a9-4da9-8695-6b07e6392294 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:19.908407 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1ad56f95-e9a9-4da9-8695-6b07e6392294 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.170380 Nov 23 14:36:19.909178 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 456/920] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:19 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:36:20.926853 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-cae79ba0-65c3-413f-8aa9-78eb1fcf1949 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:20.927460 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-cae79ba0-65c3-413f-8aa9-78eb1fcf1949 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:20.934574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cae79ba0-65c3-413f-8aa9-78eb1fcf1949 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:20.935018 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cae79ba0-65c3-413f-8aa9-78eb1fcf1949 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:20.935784 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cae79ba0-65c3-413f-8aa9-78eb1fcf1949 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:20.936212 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-cae79ba0-65c3-413f-8aa9-78eb1fcf1949 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:21.092678 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-cae79ba0-65c3-413f-8aa9-78eb1fcf1949 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:21.102391 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-cae79ba0-65c3-413f-8aa9-78eb1fcf1949 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:21.104048 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-cae79ba0-65c3-413f-8aa9-78eb1fcf1949 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:21.106004 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-cae79ba0-65c3-413f-8aa9-78eb1fcf1949 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.182953 Nov 23 14:36:21.108031 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 465/921] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:20 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:36:22.125247 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e798d7bc-c01d-4994-b6c5-824c565df44e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:22.125927 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e798d7bc-c01d-4994-b6c5-824c565df44e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:22.132148 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e798d7bc-c01d-4994-b6c5-824c565df44e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:22.135281 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e798d7bc-c01d-4994-b6c5-824c565df44e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:22.135281 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e798d7bc-c01d-4994-b6c5-824c565df44e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:22.135281 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e798d7bc-c01d-4994-b6c5-824c565df44e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:22.272992 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e798d7bc-c01d-4994-b6c5-824c565df44e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:22.282401 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e798d7bc-c01d-4994-b6c5-824c565df44e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:22.283972 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e798d7bc-c01d-4994-b6c5-824c565df44e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:22.285202 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e798d7bc-c01d-4994-b6c5-824c565df44e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.163920 Nov 23 14:36:22.285822 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 457/922] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:22 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:23.304159 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-eb7a0089-257b-43c9-8dcd-971e0b4c7f6f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:23.308358 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-eb7a0089-257b-43c9-8dcd-971e0b4c7f6f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:23.311761 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-eb7a0089-257b-43c9-8dcd-971e0b4c7f6f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:23.312100 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-eb7a0089-257b-43c9-8dcd-971e0b4c7f6f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:23.312907 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-eb7a0089-257b-43c9-8dcd-971e0b4c7f6f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:23.313333 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-eb7a0089-257b-43c9-8dcd-971e0b4c7f6f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:23.443647 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-eb7a0089-257b-43c9-8dcd-971e0b4c7f6f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:23.451684 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-eb7a0089-257b-43c9-8dcd-971e0b4c7f6f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:23.453181 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-eb7a0089-257b-43c9-8dcd-971e0b4c7f6f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:23.454314 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-eb7a0089-257b-43c9-8dcd-971e0b4c7f6f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.154079 Nov 23 14:36:23.454872 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 466/923] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:23 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:24.474367 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7f8a8d51-47c8-483e-97f6-8efd93ceadf4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:24.474984 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7f8a8d51-47c8-483e-97f6-8efd93ceadf4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:24.482084 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7f8a8d51-47c8-483e-97f6-8efd93ceadf4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:24.482559 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7f8a8d51-47c8-483e-97f6-8efd93ceadf4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:24.483337 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7f8a8d51-47c8-483e-97f6-8efd93ceadf4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:24.483766 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7f8a8d51-47c8-483e-97f6-8efd93ceadf4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:24.618539 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7f8a8d51-47c8-483e-97f6-8efd93ceadf4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:24.626850 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7f8a8d51-47c8-483e-97f6-8efd93ceadf4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:24.628346 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7f8a8d51-47c8-483e-97f6-8efd93ceadf4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:24.629480 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7f8a8d51-47c8-483e-97f6-8efd93ceadf4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.159097 Nov 23 14:36:24.630064 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 458/924] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:24 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:25.647796 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-df63adf8-884c-48ea-b2a0-f13e5a3a55a3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:25.648355 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-df63adf8-884c-48ea-b2a0-f13e5a3a55a3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:25.654203 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-df63adf8-884c-48ea-b2a0-f13e5a3a55a3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:25.654645 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-df63adf8-884c-48ea-b2a0-f13e5a3a55a3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:25.655415 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-df63adf8-884c-48ea-b2a0-f13e5a3a55a3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:25.655843 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-df63adf8-884c-48ea-b2a0-f13e5a3a55a3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:25.785325 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-df63adf8-884c-48ea-b2a0-f13e5a3a55a3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:25.794667 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-df63adf8-884c-48ea-b2a0-f13e5a3a55a3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:25.796192 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-df63adf8-884c-48ea-b2a0-f13e5a3a55a3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:25.797387 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-df63adf8-884c-48ea-b2a0-f13e5a3a55a3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.153481 Nov 23 14:36:25.797948 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 467/925] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:25 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:26.815804 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e5f73628-44b8-4805-95ff-2d0ace0910e1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:26.816431 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e5f73628-44b8-4805-95ff-2d0ace0910e1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:26.822930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e5f73628-44b8-4805-95ff-2d0ace0910e1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:26.823375 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e5f73628-44b8-4805-95ff-2d0ace0910e1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:26.824139 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e5f73628-44b8-4805-95ff-2d0ace0910e1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:26.825300 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e5f73628-44b8-4805-95ff-2d0ace0910e1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:26.998612 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e5f73628-44b8-4805-95ff-2d0ace0910e1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:27.006678 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e5f73628-44b8-4805-95ff-2d0ace0910e1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:27.008162 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e5f73628-44b8-4805-95ff-2d0ace0910e1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:27.009342 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e5f73628-44b8-4805-95ff-2d0ace0910e1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.197285 Nov 23 14:36:27.009897 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 459/926] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:26 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:28.027516 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d9496641-8fda-4643-8b7b-3afd259f3e60 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:28.028692 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d9496641-8fda-4643-8b7b-3afd259f3e60 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:28.034478 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d9496641-8fda-4643-8b7b-3afd259f3e60 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:28.034924 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d9496641-8fda-4643-8b7b-3afd259f3e60 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:28.035726 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d9496641-8fda-4643-8b7b-3afd259f3e60 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:28.036161 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d9496641-8fda-4643-8b7b-3afd259f3e60 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:28.180869 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d9496641-8fda-4643-8b7b-3afd259f3e60 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:28.189679 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d9496641-8fda-4643-8b7b-3afd259f3e60 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:28.191369 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d9496641-8fda-4643-8b7b-3afd259f3e60 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:28.192557 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d9496641-8fda-4643-8b7b-3afd259f3e60 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.168749 Nov 23 14:36:28.193113 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 468/927] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:28 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:29.210852 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ac85f8ee-9af8-4190-83b9-e466c21e3e29 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:29.211456 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ac85f8ee-9af8-4190-83b9-e466c21e3e29 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:29.217900 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ac85f8ee-9af8-4190-83b9-e466c21e3e29 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:29.218346 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ac85f8ee-9af8-4190-83b9-e466c21e3e29 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:29.219123 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ac85f8ee-9af8-4190-83b9-e466c21e3e29 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:29.219554 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ac85f8ee-9af8-4190-83b9-e466c21e3e29 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:29.415433 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ac85f8ee-9af8-4190-83b9-e466c21e3e29 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:29.424226 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ac85f8ee-9af8-4190-83b9-e466c21e3e29 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:29.425750 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ac85f8ee-9af8-4190-83b9-e466c21e3e29 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:29.426967 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ac85f8ee-9af8-4190-83b9-e466c21e3e29 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.219842 Nov 23 14:36:29.427456 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 460/928] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:29 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:30.446658 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-042982c2-c504-4c69-a3f3-95ccb3b7d60f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:30.447206 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-042982c2-c504-4c69-a3f3-95ccb3b7d60f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:30.453935 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-042982c2-c504-4c69-a3f3-95ccb3b7d60f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:30.454387 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-042982c2-c504-4c69-a3f3-95ccb3b7d60f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:30.455202 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-042982c2-c504-4c69-a3f3-95ccb3b7d60f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:30.455638 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-042982c2-c504-4c69-a3f3-95ccb3b7d60f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:30.615329 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-042982c2-c504-4c69-a3f3-95ccb3b7d60f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:30.623693 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-042982c2-c504-4c69-a3f3-95ccb3b7d60f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:30.625207 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-042982c2-c504-4c69-a3f3-95ccb3b7d60f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:30.626374 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-042982c2-c504-4c69-a3f3-95ccb3b7d60f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.183370 Nov 23 14:36:30.626938 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 469/929] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:30 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:31.645140 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4cca7e44-d92d-47f1-a6ac-12f504cc9229 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:31.645687 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4cca7e44-d92d-47f1-a6ac-12f504cc9229 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:31.652147 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4cca7e44-d92d-47f1-a6ac-12f504cc9229 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:31.652641 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4cca7e44-d92d-47f1-a6ac-12f504cc9229 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:31.653453 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4cca7e44-d92d-47f1-a6ac-12f504cc9229 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:31.653867 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4cca7e44-d92d-47f1-a6ac-12f504cc9229 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:31.797391 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4cca7e44-d92d-47f1-a6ac-12f504cc9229 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:31.805582 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4cca7e44-d92d-47f1-a6ac-12f504cc9229 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:31.807063 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4cca7e44-d92d-47f1-a6ac-12f504cc9229 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:31.809031 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4cca7e44-d92d-47f1-a6ac-12f504cc9229 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.167273 Nov 23 14:36:31.809691 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 461/930] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:31 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:32.827561 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-175f21f4-c7ca-4fb4-83c6-ce38f81abac1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:32.828368 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-175f21f4-c7ca-4fb4-83c6-ce38f81abac1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:32.834766 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-175f21f4-c7ca-4fb4-83c6-ce38f81abac1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:32.835221 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-175f21f4-c7ca-4fb4-83c6-ce38f81abac1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:32.835999 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-175f21f4-c7ca-4fb4-83c6-ce38f81abac1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:32.836465 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-175f21f4-c7ca-4fb4-83c6-ce38f81abac1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:32.971334 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-175f21f4-c7ca-4fb4-83c6-ce38f81abac1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:32.979740 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-175f21f4-c7ca-4fb4-83c6-ce38f81abac1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:32.982556 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-175f21f4-c7ca-4fb4-83c6-ce38f81abac1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:32.983722 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-175f21f4-c7ca-4fb4-83c6-ce38f81abac1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.160705 Nov 23 14:36:32.984296 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 470/931] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:32 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:34.004148 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-18470598-3f88-47d1-ac18-898aa4b70179 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:34.006617 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-18470598-3f88-47d1-ac18-898aa4b70179 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:34.022696 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-18470598-3f88-47d1-ac18-898aa4b70179 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:34.023646 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-18470598-3f88-47d1-ac18-898aa4b70179 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:34.024583 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-18470598-3f88-47d1-ac18-898aa4b70179 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:34.025080 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-18470598-3f88-47d1-ac18-898aa4b70179 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:34.159052 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-18470598-3f88-47d1-ac18-898aa4b70179 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:34.167144 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-18470598-3f88-47d1-ac18-898aa4b70179 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:34.169501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-18470598-3f88-47d1-ac18-898aa4b70179 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:34.170644 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-18470598-3f88-47d1-ac18-898aa4b70179 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.170772 Nov 23 14:36:34.171228 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 462/932] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:33 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:35.188859 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5f7d16c3-4ddc-4964-a653-468dd1087958 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:35.189459 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5f7d16c3-4ddc-4964-a653-468dd1087958 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:35.196067 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5f7d16c3-4ddc-4964-a653-468dd1087958 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:35.196557 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5f7d16c3-4ddc-4964-a653-468dd1087958 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:35.197324 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5f7d16c3-4ddc-4964-a653-468dd1087958 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:35.197751 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5f7d16c3-4ddc-4964-a653-468dd1087958 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:35.329525 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5f7d16c3-4ddc-4964-a653-468dd1087958 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:35.352261 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5f7d16c3-4ddc-4964-a653-468dd1087958 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:35.353555 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5f7d16c3-4ddc-4964-a653-468dd1087958 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:35.354766 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5f7d16c3-4ddc-4964-a653-468dd1087958 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.169707 Nov 23 14:36:35.355339 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 471/933] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:35 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:36.373143 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e3ac3c6b-303c-4444-afad-2bc3630e4775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:36.373772 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e3ac3c6b-303c-4444-afad-2bc3630e4775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:36.379990 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e3ac3c6b-303c-4444-afad-2bc3630e4775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:36.380583 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e3ac3c6b-303c-4444-afad-2bc3630e4775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:36.381305 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e3ac3c6b-303c-4444-afad-2bc3630e4775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:36.381731 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e3ac3c6b-303c-4444-afad-2bc3630e4775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:36.511166 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e3ac3c6b-303c-4444-afad-2bc3630e4775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:36.519676 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e3ac3c6b-303c-4444-afad-2bc3630e4775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:36.521226 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e3ac3c6b-303c-4444-afad-2bc3630e4775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:36.522374 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e3ac3c6b-303c-4444-afad-2bc3630e4775 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.153118 Nov 23 14:36:36.522919 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 463/934] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:36 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:37.541123 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7cd23f57-ecd3-4a57-9a3d-744185e402a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:37.541796 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7cd23f57-ecd3-4a57-9a3d-744185e402a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:37.548155 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7cd23f57-ecd3-4a57-9a3d-744185e402a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:37.548627 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7cd23f57-ecd3-4a57-9a3d-744185e402a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:37.549395 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7cd23f57-ecd3-4a57-9a3d-744185e402a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:37.549827 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7cd23f57-ecd3-4a57-9a3d-744185e402a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:37.684295 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7cd23f57-ecd3-4a57-9a3d-744185e402a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:37.692744 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7cd23f57-ecd3-4a57-9a3d-744185e402a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:37.694602 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7cd23f57-ecd3-4a57-9a3d-744185e402a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:37.695780 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7cd23f57-ecd3-4a57-9a3d-744185e402a4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.158325 Nov 23 14:36:37.699156 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 472/935] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:37 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:38.714054 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-bcaa8b59-84a4-42fd-b348-0588a5c19bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:38.714742 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-bcaa8b59-84a4-42fd-b348-0588a5c19bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:38.721161 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bcaa8b59-84a4-42fd-b348-0588a5c19bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:38.721607 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bcaa8b59-84a4-42fd-b348-0588a5c19bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:38.722409 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bcaa8b59-84a4-42fd-b348-0588a5c19bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:38.722846 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bcaa8b59-84a4-42fd-b348-0588a5c19bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:38.859223 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-bcaa8b59-84a4-42fd-b348-0588a5c19bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:38.867786 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-bcaa8b59-84a4-42fd-b348-0588a5c19bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:38.869308 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-bcaa8b59-84a4-42fd-b348-0588a5c19bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:38.870492 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-bcaa8b59-84a4-42fd-b348-0588a5c19bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.160162 Nov 23 14:36:38.871576 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 464/936] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:38 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:39.893540 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0f4d4f48-8bf7-4d36-82f6-c42bb06c2482 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:39.893540 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0f4d4f48-8bf7-4d36-82f6-c42bb06c2482 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:39.898028 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0f4d4f48-8bf7-4d36-82f6-c42bb06c2482 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:39.898542 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0f4d4f48-8bf7-4d36-82f6-c42bb06c2482 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:39.899441 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0f4d4f48-8bf7-4d36-82f6-c42bb06c2482 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:39.900043 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0f4d4f48-8bf7-4d36-82f6-c42bb06c2482 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:39.908880 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-a564dcb9-cfa0-41c7-af94-5d5ee638146c req-adeb2352-75c3-4775-91fe-27fc53034583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c8dbd0-2f80-4158-923b-24f263fd9832", "name": "network-vif-plugged", "status": "completed", "tag": "643c4469-7e07-47b2-806d-0dfc74abe378"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:36:39.910545 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:36:39.910545 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:36:39.917915 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-a564dcb9-cfa0-41c7-af94-5d5ee638146c req-adeb2352-75c3-4775-91fe-27fc53034583 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:39.922070 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-a564dcb9-cfa0-41c7-af94-5d5ee638146c req-adeb2352-75c3-4775-91fe-27fc53034583 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:39.929472 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-a564dcb9-cfa0-41c7-af94-5d5ee638146c req-adeb2352-75c3-4775-91fe-27fc53034583 service nova] Creating event network-vif-plugged:643c4469-7e07-47b2-806d-0dfc74abe378 for instance f5c8dbd0-2f80-4158-923b-24f263fd9832 on hv-cinder-80475 Nov 23 14:36:39.935596 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-a564dcb9-cfa0-41c7-af94-5d5ee638146c req-adeb2352-75c3-4775-91fe-27fc53034583 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149827 Nov 23 14:36:39.936261 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 473/937] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:36:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:36:40.039472 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0f4d4f48-8bf7-4d36-82f6-c42bb06c2482 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:40.048266 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0f4d4f48-8bf7-4d36-82f6-c42bb06c2482 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:40.049731 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0f4d4f48-8bf7-4d36-82f6-c42bb06c2482 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:40.050898 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0f4d4f48-8bf7-4d36-82f6-c42bb06c2482 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.164831 Nov 23 14:36:40.051450 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 465/938] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:39 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:41.070806 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-23ae4149-8b87-4531-b597-828398ad6bca tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:41.071483 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-23ae4149-8b87-4531-b597-828398ad6bca tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:41.079176 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-23ae4149-8b87-4531-b597-828398ad6bca tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:41.079620 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-23ae4149-8b87-4531-b597-828398ad6bca tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:41.080421 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-23ae4149-8b87-4531-b597-828398ad6bca tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:41.080852 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-23ae4149-8b87-4531-b597-828398ad6bca tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:41.217615 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-23ae4149-8b87-4531-b597-828398ad6bca tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:41.225778 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-23ae4149-8b87-4531-b597-828398ad6bca tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:41.227285 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-23ae4149-8b87-4531-b597-828398ad6bca tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:41.228450 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-23ae4149-8b87-4531-b597-828398ad6bca tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.162096 Nov 23 14:36:41.229019 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 474/939] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:41 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:42.247837 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-88169d2a-fd98-4213-9603-4b725e82310e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:42.248501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-88169d2a-fd98-4213-9603-4b725e82310e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:42.254950 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-88169d2a-fd98-4213-9603-4b725e82310e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:42.255405 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-88169d2a-fd98-4213-9603-4b725e82310e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:42.256188 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-88169d2a-fd98-4213-9603-4b725e82310e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:42.256674 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-88169d2a-fd98-4213-9603-4b725e82310e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:42.397744 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-88169d2a-fd98-4213-9603-4b725e82310e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:42.406422 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-88169d2a-fd98-4213-9603-4b725e82310e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:42.407910 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-88169d2a-fd98-4213-9603-4b725e82310e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:42.409093 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-88169d2a-fd98-4213-9603-4b725e82310e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.165833 Nov 23 14:36:42.409651 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 466/940] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:42 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:43.428326 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-67aacfae-f213-413f-8d60-f95ba0e18e4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:43.428944 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-67aacfae-f213-413f-8d60-f95ba0e18e4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:43.435813 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-67aacfae-f213-413f-8d60-f95ba0e18e4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:43.436287 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-67aacfae-f213-413f-8d60-f95ba0e18e4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:43.437070 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-67aacfae-f213-413f-8d60-f95ba0e18e4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:43.437497 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-67aacfae-f213-413f-8d60-f95ba0e18e4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:43.573234 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-67aacfae-f213-413f-8d60-f95ba0e18e4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:43.581493 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-67aacfae-f213-413f-8d60-f95ba0e18e4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:43.582964 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-67aacfae-f213-413f-8d60-f95ba0e18e4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:43.584088 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-67aacfae-f213-413f-8d60-f95ba0e18e4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1808 microversion: 2.20 time: 0.159539 Nov 23 14:36:43.584779 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 475/941] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:43 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:36:44.602722 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-df027bff-22fa-4f78-bacc-78add90b03ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:36:44.603324 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-df027bff-22fa-4f78-bacc-78add90b03ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:36:44.609699 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-df027bff-22fa-4f78-bacc-78add90b03ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:44.610145 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-df027bff-22fa-4f78-bacc-78add90b03ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:44.610914 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-df027bff-22fa-4f78-bacc-78add90b03ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:36:44.611349 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-df027bff-22fa-4f78-bacc-78add90b03ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:36:44.742006 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-df027bff-22fa-4f78-bacc-78add90b03ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:44.750652 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-df027bff-22fa-4f78-bacc-78add90b03ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:44.752145 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-df027bff-22fa-4f78-bacc-78add90b03ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:36:44.754179 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-df027bff-22fa-4f78-bacc-78add90b03ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1795 microversion: 2.20 time: 0.154418 Nov 23 14:36:44.754179 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 467/942] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:36:44 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1795 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:37:12.116000 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:37:12.116754 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: Tue Nov 23 14:37:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:37:12.430208 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:37:12.430208 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: Tue Nov 23 14:37:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:37:20.264838 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-4f4e9b58-4fe3-4219-b491-cdbd4f07ee5b tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Action: 'create', calling method: .version_select at 0x7f2082757dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-356279930"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:37:20.278676 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-4f4e9b58-4fe3-4219-b491-cdbd4f07ee5b tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Getting quotas for project 3c896e07f31448e08e2af756467d627d. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:37:20.284056 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-4f4e9b58-4fe3-4219-b491-cdbd4f07ee5b tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Getting quotas for user f04392c74e0e4d288cd856b081f6bb75 and project 3c896e07f31448e08e2af756467d627d. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:37:20.456709 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-4f4e9b58-4fe3-4219-b491-cdbd4f07ee5b tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Getting quotas for project 3c896e07f31448e08e2af756467d627d. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:37:20.460425 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-4f4e9b58-4fe3-4219-b491-cdbd4f07ee5b tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Getting quotas for user f04392c74e0e4d288cd856b081f6bb75 and project 3c896e07f31448e08e2af756467d627d. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:37:20.472994 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-4f4e9b58-4fe3-4219-b491-cdbd4f07ee5b tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.213101 Nov 23 14:37:20.473577 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 476/943] 10.222.0.82 () {60 vars in 1157 bytes} [Tue Nov 23 14:37:20 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:20.572458 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1b2a3677-9f0c-4014-877c-538f72999248 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-403703874", "imageRef": "42b6e8c4-08a8-4873-a817-073d31eac801", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-356279930", "networks": [{"uuid": "0994ee58-598b-4aee-9458-250b5bbac33e"}]}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:37:20.623515 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.network.neutron [None req-1b2a3677-9f0c-4014-877c-538f72999248 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] validate_networks() for [('0994ee58-598b-4aee-9458-250b5bbac33e', None, None, None, None, None)] {{(pid=116787) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:37:21.046124 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-1b2a3677-9f0c-4014-877c-538f72999248 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Flavor limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:37:21.046620 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-1b2a3677-9f0c-4014-877c-538f72999248 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Image limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:37:21.047090 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-1b2a3677-9f0c-4014-877c-538f72999248 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Flavor pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:37:21.047492 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-1b2a3677-9f0c-4014-877c-538f72999248 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Image pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:37:21.047895 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-1b2a3677-9f0c-4014-877c-538f72999248 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:37:21.056850 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1b2a3677-9f0c-4014-877c-538f72999248 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:21.057320 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1b2a3677-9f0c-4014-877c-538f72999248 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:21.058091 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1b2a3677-9f0c-4014-877c-538f72999248 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:21.058518 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1b2a3677-9f0c-4014-877c-538f72999248 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:21.076645 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-1b2a3677-9f0c-4014-877c-538f72999248 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Getting quotas for project 3c896e07f31448e08e2af756467d627d. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:37:21.080508 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-1b2a3677-9f0c-4014-877c-538f72999248 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Getting quotas for user f04392c74e0e4d288cd856b081f6bb75 and project 3c896e07f31448e08e2af756467d627d. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:37:21.091052 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1b2a3677-9f0c-4014-877c-538f72999248 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Going to run 1 instances... {{(pid=116787) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:37:21.093327 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1b2a3677-9f0c-4014-877c-538f72999248 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42b6e8c4-08a8-4873-a817-073d31eac801',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:37:21.350875 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1b2a3677-9f0c-4014-877c-538f72999248 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782338 Nov 23 14:37:21.351512 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 468/944] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:37:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 14:37:21.362142 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-8a66f75f-41f3-482a-a170-d24acd127215 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:21.363399 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-8a66f75f-41f3-482a-a170-d24acd127215 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:21.427482 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-8a66f75f-41f3-482a-a170-d24acd127215 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:21.435336 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-8a66f75f-41f3-482a-a170-d24acd127215 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1257 microversion: 2.1 time: 0.077426 Nov 23 14:37:21.435997 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 477/945] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:21 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1257 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:37:22.195842 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-af408702-c3a0-44bb-9d01-3d66016708dd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:22.196439 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-af408702-c3a0-44bb-9d01-3d66016708dd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:22.205284 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-af408702-c3a0-44bb-9d01-3d66016708dd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:22.205735 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-af408702-c3a0-44bb-9d01-3d66016708dd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:22.206501 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-af408702-c3a0-44bb-9d01-3d66016708dd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:22.206934 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-af408702-c3a0-44bb-9d01-3d66016708dd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:22.283900 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-af408702-c3a0-44bb-9d01-3d66016708dd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lazy-loading 'services' on Instance uuid ace5aa86-e88f-49e1-b497-966c499eba99 {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:37:22.451837 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9dc7cc12-fa8f-40d3-9032-7445ead56f79 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:22.452465 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9dc7cc12-fa8f-40d3-9032-7445ead56f79 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:22.458722 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9dc7cc12-fa8f-40d3-9032-7445ead56f79 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:22.459164 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9dc7cc12-fa8f-40d3-9032-7445ead56f79 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:22.459925 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9dc7cc12-fa8f-40d3-9032-7445ead56f79 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:22.460377 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9dc7cc12-fa8f-40d3-9032-7445ead56f79 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:22.521912 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9dc7cc12-fa8f-40d3-9032-7445ead56f79 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:22.529556 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9dc7cc12-fa8f-40d3-9032-7445ead56f79 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1261 microversion: 2.1 time: 0.081632 Nov 23 14:37:22.530472 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 478/946] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:22 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:37:22.542638 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-af408702-c3a0-44bb-9d01-3d66016708dd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "DELETE /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/os-volume_attachments/49e2dcf8-5dda-40a6-8ab9-5a51b381c1d3" status: 202 len: 0 microversion: 2.1 time: 0.349704 Nov 23 14:37:22.543214 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 469/947] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Nov 23 14:37:22 2021] DELETE /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/os-volume_attachments/49e2dcf8-5dda-40a6-8ab9-5a51b381c1d3 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:37:23.547671 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-eb6f4ada-ca7f-4661-8c1f-c2590a2b563f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:23.548217 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-eb6f4ada-ca7f-4661-8c1f-c2590a2b563f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:23.554347 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-eb6f4ada-ca7f-4661-8c1f-c2590a2b563f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:23.554997 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-eb6f4ada-ca7f-4661-8c1f-c2590a2b563f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:23.555555 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-eb6f4ada-ca7f-4661-8c1f-c2590a2b563f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:23.555988 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-eb6f4ada-ca7f-4661-8c1f-c2590a2b563f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:23.615364 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-eb6f4ada-ca7f-4661-8c1f-c2590a2b563f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:23.623437 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-eb6f4ada-ca7f-4661-8c1f-c2590a2b563f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1327 microversion: 2.1 time: 0.079284 Nov 23 14:37:23.624280 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 479/948] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:23 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1327 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:24.642704 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b322b0d4-721f-4aab-9e07-1596c54710ef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:24.643526 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b322b0d4-721f-4aab-9e07-1596c54710ef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:24.649920 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b322b0d4-721f-4aab-9e07-1596c54710ef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:24.650805 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b322b0d4-721f-4aab-9e07-1596c54710ef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:24.652058 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b322b0d4-721f-4aab-9e07-1596c54710ef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:24.659009 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b322b0d4-721f-4aab-9e07-1596c54710ef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:24.899608 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-b322b0d4-721f-4aab-9e07-1596c54710ef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:24.907721 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b322b0d4-721f-4aab-9e07-1596c54710ef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.269646 Nov 23 14:37:24.908786 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 470/949] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:24 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:25.156820 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-3b4c39fd-5685-42d1-aa90-52b167821373 req-c7d63388-c2d2-4564-afb7-b360cce8cab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f30691a4-e578-4658-afcf-033a9a8ef9fe", "tag": "18ae7b24-5975-46e7-908e-8cbd192f6d2f"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:37:25.159085 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:37:25.159085 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:37:25.167830 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-3b4c39fd-5685-42d1-aa90-52b167821373 req-c7d63388-c2d2-4564-afb7-b360cce8cab7 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:25.168298 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-3b4c39fd-5685-42d1-aa90-52b167821373 req-c7d63388-c2d2-4564-afb7-b360cce8cab7 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:25.184915 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-3b4c39fd-5685-42d1-aa90-52b167821373 req-c7d63388-c2d2-4564-afb7-b360cce8cab7 service nova] Creating event network-changed:18ae7b24-5975-46e7-908e-8cbd192f6d2f for instance f30691a4-e578-4658-afcf-033a9a8ef9fe on hv-cinder-80475 Nov 23 14:37:25.193314 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-3b4c39fd-5685-42d1-aa90-52b167821373 req-c7d63388-c2d2-4564-afb7-b360cce8cab7 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040193 Nov 23 14:37:25.193966 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 480/950] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:37:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:37:25.925614 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-48f193b3-4592-445b-9df3-458a8edd1fb4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:25.926461 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-48f193b3-4592-445b-9df3-458a8edd1fb4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:25.934328 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-48f193b3-4592-445b-9df3-458a8edd1fb4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:25.934780 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-48f193b3-4592-445b-9df3-458a8edd1fb4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:25.935570 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-48f193b3-4592-445b-9df3-458a8edd1fb4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:25.936006 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-48f193b3-4592-445b-9df3-458a8edd1fb4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:26.080339 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-48f193b3-4592-445b-9df3-458a8edd1fb4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:26.088789 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-48f193b3-4592-445b-9df3-458a8edd1fb4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.166797 Nov 23 14:37:26.089631 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 471/951] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:25 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:27.106853 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-565d0c1a-7689-49be-a01e-722ec2654ff7 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:27.107513 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-565d0c1a-7689-49be-a01e-722ec2654ff7 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:27.113675 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-565d0c1a-7689-49be-a01e-722ec2654ff7 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:27.114123 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-565d0c1a-7689-49be-a01e-722ec2654ff7 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:27.114898 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-565d0c1a-7689-49be-a01e-722ec2654ff7 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:27.115330 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-565d0c1a-7689-49be-a01e-722ec2654ff7 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:27.253875 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-565d0c1a-7689-49be-a01e-722ec2654ff7 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:27.261835 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-565d0c1a-7689-49be-a01e-722ec2654ff7 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.159693 Nov 23 14:37:27.262754 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 481/952] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:27 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:28.284362 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8ccd1575-9a19-4864-aac6-74db50559255 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:28.285507 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8ccd1575-9a19-4864-aac6-74db50559255 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:28.292889 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8ccd1575-9a19-4864-aac6-74db50559255 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:28.293488 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8ccd1575-9a19-4864-aac6-74db50559255 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:28.294199 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8ccd1575-9a19-4864-aac6-74db50559255 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:28.294629 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8ccd1575-9a19-4864-aac6-74db50559255 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:28.449419 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-8ccd1575-9a19-4864-aac6-74db50559255 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:28.458477 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8ccd1575-9a19-4864-aac6-74db50559255 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.182135 Nov 23 14:37:28.459062 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 472/953] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:28 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:29.478347 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b3b53a2d-5c5a-429d-ad8a-310b20f07c75 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:29.479099 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b3b53a2d-5c5a-429d-ad8a-310b20f07c75 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:29.485309 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b3b53a2d-5c5a-429d-ad8a-310b20f07c75 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:29.485759 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b3b53a2d-5c5a-429d-ad8a-310b20f07c75 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:29.486542 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b3b53a2d-5c5a-429d-ad8a-310b20f07c75 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:29.486975 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b3b53a2d-5c5a-429d-ad8a-310b20f07c75 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:29.629992 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-b3b53a2d-5c5a-429d-ad8a-310b20f07c75 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:29.639213 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b3b53a2d-5c5a-429d-ad8a-310b20f07c75 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.164926 Nov 23 14:37:29.640091 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 482/954] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:29 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:30.656152 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c6c4f016-6493-40f0-bf3a-b749f0221d9e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:30.656745 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c6c4f016-6493-40f0-bf3a-b749f0221d9e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:30.662906 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c6c4f016-6493-40f0-bf3a-b749f0221d9e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:30.663345 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c6c4f016-6493-40f0-bf3a-b749f0221d9e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:30.664131 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c6c4f016-6493-40f0-bf3a-b749f0221d9e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:30.664561 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c6c4f016-6493-40f0-bf3a-b749f0221d9e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:30.798425 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c6c4f016-6493-40f0-bf3a-b749f0221d9e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:30.805525 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c6c4f016-6493-40f0-bf3a-b749f0221d9e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.153117 Nov 23 14:37:30.807056 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 473/955] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:30 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:31.831647 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-697a0d65-fe12-477a-b290-04c6efb96673 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:31.832347 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-697a0d65-fe12-477a-b290-04c6efb96673 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:31.851053 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-697a0d65-fe12-477a-b290-04c6efb96673 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:31.851493 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-697a0d65-fe12-477a-b290-04c6efb96673 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:31.852296 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-697a0d65-fe12-477a-b290-04c6efb96673 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:31.852726 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-697a0d65-fe12-477a-b290-04c6efb96673 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:31.994465 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-697a0d65-fe12-477a-b290-04c6efb96673 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:32.002586 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-697a0d65-fe12-477a-b290-04c6efb96673 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.183528 Nov 23 14:37:32.003519 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 483/956] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:31 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:37:33.020425 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a21adb24-7354-42b6-9626-b4b7882fdeed tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:33.021135 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a21adb24-7354-42b6-9626-b4b7882fdeed tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:33.027440 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a21adb24-7354-42b6-9626-b4b7882fdeed tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:33.027974 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a21adb24-7354-42b6-9626-b4b7882fdeed tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:33.028869 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a21adb24-7354-42b6-9626-b4b7882fdeed tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:33.029378 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a21adb24-7354-42b6-9626-b4b7882fdeed tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:33.169780 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a21adb24-7354-42b6-9626-b4b7882fdeed tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:33.176976 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a21adb24-7354-42b6-9626-b4b7882fdeed tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.160229 Nov 23 14:37:33.177538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 474/957] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:33 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:34.194871 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e27cf248-20d2-4c43-8397-47b8ec51fc8f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:34.196177 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e27cf248-20d2-4c43-8397-47b8ec51fc8f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:34.204016 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e27cf248-20d2-4c43-8397-47b8ec51fc8f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:34.204992 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e27cf248-20d2-4c43-8397-47b8ec51fc8f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:34.206039 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e27cf248-20d2-4c43-8397-47b8ec51fc8f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:34.206698 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e27cf248-20d2-4c43-8397-47b8ec51fc8f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:34.358132 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e27cf248-20d2-4c43-8397-47b8ec51fc8f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:34.365425 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e27cf248-20d2-4c43-8397-47b8ec51fc8f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.174391 Nov 23 14:37:34.366135 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 484/958] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:34 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:35.382545 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-dfbbb107-2d3c-40fc-a2f1-e55cd556dc3a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:35.383151 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-dfbbb107-2d3c-40fc-a2f1-e55cd556dc3a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:35.390702 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dfbbb107-2d3c-40fc-a2f1-e55cd556dc3a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:35.391152 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dfbbb107-2d3c-40fc-a2f1-e55cd556dc3a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:35.391924 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dfbbb107-2d3c-40fc-a2f1-e55cd556dc3a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:35.392382 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dfbbb107-2d3c-40fc-a2f1-e55cd556dc3a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:35.525526 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-dfbbb107-2d3c-40fc-a2f1-e55cd556dc3a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:35.532614 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-dfbbb107-2d3c-40fc-a2f1-e55cd556dc3a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.153738 Nov 23 14:37:35.533173 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 475/959] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:35 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:36.554210 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-8b8fe0df-b188-42de-a8c5-46f96e5bd43e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:36.554929 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-8b8fe0df-b188-42de-a8c5-46f96e5bd43e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:36.561668 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8b8fe0df-b188-42de-a8c5-46f96e5bd43e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:36.562122 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8b8fe0df-b188-42de-a8c5-46f96e5bd43e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:36.562879 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8b8fe0df-b188-42de-a8c5-46f96e5bd43e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:36.563321 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8b8fe0df-b188-42de-a8c5-46f96e5bd43e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:36.690144 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-8b8fe0df-b188-42de-a8c5-46f96e5bd43e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:36.697929 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-8b8fe0df-b188-42de-a8c5-46f96e5bd43e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.147501 Nov 23 14:37:36.698492 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 485/960] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:36 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:37.715733 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-bf088c1d-9618-4464-addc-69104ab3dabd tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:37.716367 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-bf088c1d-9618-4464-addc-69104ab3dabd tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:37.723797 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bf088c1d-9618-4464-addc-69104ab3dabd tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:37.724262 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bf088c1d-9618-4464-addc-69104ab3dabd tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:37.725074 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bf088c1d-9618-4464-addc-69104ab3dabd tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:37.725701 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bf088c1d-9618-4464-addc-69104ab3dabd tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:37.968208 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-bf088c1d-9618-4464-addc-69104ab3dabd tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:37.976623 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-bf088c1d-9618-4464-addc-69104ab3dabd tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.265291 Nov 23 14:37:37.977211 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 476/961] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:37 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:37:38.391304 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3e5b368d-53ab-4c77-858f-80fd91cc752f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:37:38.397670 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3e5b368d-53ab-4c77-858f-80fd91cc752f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:38.398104 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3e5b368d-53ab-4c77-858f-80fd91cc752f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:38.422202 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3e5b368d-53ab-4c77-858f-80fd91cc752f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Going to try to stop instance {{(pid=116788) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 23 14:37:38.640962 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3e5b368d-53ab-4c77-858f-80fd91cc752f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 202 len: 0 microversion: 2.1 time: 0.253059 Nov 23 14:37:38.641570 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 486/962] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:37:38 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:37:38.649485 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c786a3e2-ea59-4874-afe9-a05b781e6a7e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:38.650451 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c786a3e2-ea59-4874-afe9-a05b781e6a7e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:38.656140 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c786a3e2-ea59-4874-afe9-a05b781e6a7e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:38.656660 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c786a3e2-ea59-4874-afe9-a05b781e6a7e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:38.657430 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c786a3e2-ea59-4874-afe9-a05b781e6a7e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:38.657858 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c786a3e2-ea59-4874-afe9-a05b781e6a7e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:38.791924 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c786a3e2-ea59-4874-afe9-a05b781e6a7e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:38.799470 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c786a3e2-ea59-4874-afe9-a05b781e6a7e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.153596 Nov 23 14:37:38.800017 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 477/963] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:38 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:38.994726 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-adc82cef-374e-4887-a4cc-7ba81d633702 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:38.998993 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-adc82cef-374e-4887-a4cc-7ba81d633702 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:39.001584 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-adc82cef-374e-4887-a4cc-7ba81d633702 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:39.002029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-adc82cef-374e-4887-a4cc-7ba81d633702 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:39.002798 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-adc82cef-374e-4887-a4cc-7ba81d633702 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:39.003232 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-adc82cef-374e-4887-a4cc-7ba81d633702 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:39.131325 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-adc82cef-374e-4887-a4cc-7ba81d633702 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:39.139292 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-adc82cef-374e-4887-a4cc-7ba81d633702 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.148637 Nov 23 14:37:39.139860 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 487/964] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:38 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:39.817153 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5cbcaf6e-e9cd-445d-b8f2-060d5205d5ea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:39.817762 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5cbcaf6e-e9cd-445d-b8f2-060d5205d5ea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:39.824643 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5cbcaf6e-e9cd-445d-b8f2-060d5205d5ea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:39.825097 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5cbcaf6e-e9cd-445d-b8f2-060d5205d5ea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:39.825880 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5cbcaf6e-e9cd-445d-b8f2-060d5205d5ea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:39.826314 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5cbcaf6e-e9cd-445d-b8f2-060d5205d5ea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:39.958060 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5cbcaf6e-e9cd-445d-b8f2-060d5205d5ea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:39.965930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5cbcaf6e-e9cd-445d-b8f2-060d5205d5ea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.152447 Nov 23 14:37:39.966496 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 478/965] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:39 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:40.156602 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-0635aa29-42a4-4d9b-9fb2-03cb167d8f4f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:40.157143 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-0635aa29-42a4-4d9b-9fb2-03cb167d8f4f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:40.163264 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0635aa29-42a4-4d9b-9fb2-03cb167d8f4f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:40.163703 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0635aa29-42a4-4d9b-9fb2-03cb167d8f4f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:40.164495 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0635aa29-42a4-4d9b-9fb2-03cb167d8f4f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:40.164926 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0635aa29-42a4-4d9b-9fb2-03cb167d8f4f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:40.298431 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-0635aa29-42a4-4d9b-9fb2-03cb167d8f4f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:40.305553 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-0635aa29-42a4-4d9b-9fb2-03cb167d8f4f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.152643 Nov 23 14:37:40.306669 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 488/966] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:40 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:40.982722 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1c80b6ac-e4c5-40a7-9875-a7cb9364f592 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:40.983361 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1c80b6ac-e4c5-40a7-9875-a7cb9364f592 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:40.989521 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1c80b6ac-e4c5-40a7-9875-a7cb9364f592 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:40.989963 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1c80b6ac-e4c5-40a7-9875-a7cb9364f592 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:40.990758 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1c80b6ac-e4c5-40a7-9875-a7cb9364f592 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:40.991188 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1c80b6ac-e4c5-40a7-9875-a7cb9364f592 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:41.120262 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-1c80b6ac-e4c5-40a7-9875-a7cb9364f592 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:41.127447 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1c80b6ac-e4c5-40a7-9875-a7cb9364f592 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.148474 Nov 23 14:37:41.128011 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 479/967] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:40 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:41.324373 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a392d2a7-0d8f-4355-889c-580591552c97 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:41.324904 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a392d2a7-0d8f-4355-889c-580591552c97 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:41.331122 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a392d2a7-0d8f-4355-889c-580591552c97 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:41.331567 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a392d2a7-0d8f-4355-889c-580591552c97 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:41.332366 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a392d2a7-0d8f-4355-889c-580591552c97 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:41.332796 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a392d2a7-0d8f-4355-889c-580591552c97 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:41.459837 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a392d2a7-0d8f-4355-889c-580591552c97 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:41.467557 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a392d2a7-0d8f-4355-889c-580591552c97 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.147243 Nov 23 14:37:41.468115 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 489/968] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:41 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:42.144216 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c0fc335d-20de-48fc-894a-af5bfcfb7040 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:42.144836 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c0fc335d-20de-48fc-894a-af5bfcfb7040 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:42.151218 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c0fc335d-20de-48fc-894a-af5bfcfb7040 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:42.151661 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c0fc335d-20de-48fc-894a-af5bfcfb7040 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:42.152455 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c0fc335d-20de-48fc-894a-af5bfcfb7040 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:42.152887 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c0fc335d-20de-48fc-894a-af5bfcfb7040 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:42.288496 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c0fc335d-20de-48fc-894a-af5bfcfb7040 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:42.296531 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c0fc335d-20de-48fc-894a-af5bfcfb7040 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.156306 Nov 23 14:37:42.297166 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 480/969] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:42 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:42.483886 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-09198a48-6266-487f-a28e-c6dc63523786 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:42.484517 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-09198a48-6266-487f-a28e-c6dc63523786 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:42.490713 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-09198a48-6266-487f-a28e-c6dc63523786 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:42.491157 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-09198a48-6266-487f-a28e-c6dc63523786 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:42.491929 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-09198a48-6266-487f-a28e-c6dc63523786 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:42.492369 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-09198a48-6266-487f-a28e-c6dc63523786 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:42.625925 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-09198a48-6266-487f-a28e-c6dc63523786 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:42.633288 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-09198a48-6266-487f-a28e-c6dc63523786 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.153064 Nov 23 14:37:42.633920 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 490/970] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:42 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:43.314410 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9b45705d-b6ba-46b8-990d-1de3c2848f41 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:43.315024 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9b45705d-b6ba-46b8-990d-1de3c2848f41 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:43.321979 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9b45705d-b6ba-46b8-990d-1de3c2848f41 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:43.322534 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9b45705d-b6ba-46b8-990d-1de3c2848f41 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:43.323328 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9b45705d-b6ba-46b8-990d-1de3c2848f41 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:43.323760 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9b45705d-b6ba-46b8-990d-1de3c2848f41 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:43.452224 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9b45705d-b6ba-46b8-990d-1de3c2848f41 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:43.459379 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9b45705d-b6ba-46b8-990d-1de3c2848f41 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.148663 Nov 23 14:37:43.459940 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 481/971] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:43 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:43.650645 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6a98ee01-619d-4fe3-8f4b-cac23d45a64f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:43.651239 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6a98ee01-619d-4fe3-8f4b-cac23d45a64f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:43.657485 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6a98ee01-619d-4fe3-8f4b-cac23d45a64f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:43.657925 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6a98ee01-619d-4fe3-8f4b-cac23d45a64f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:43.658687 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6a98ee01-619d-4fe3-8f4b-cac23d45a64f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:43.659113 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6a98ee01-619d-4fe3-8f4b-cac23d45a64f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:43.786395 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6a98ee01-619d-4fe3-8f4b-cac23d45a64f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:43.793752 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6a98ee01-619d-4fe3-8f4b-cac23d45a64f tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.147762 Nov 23 14:37:43.794307 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 491/972] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:43 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:44.381249 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-38c714ff-8984-419a-ba33-7c39e2e19f27 req-2d51a922-ed98-49fb-ba3e-063a6b907daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f30691a4-e578-4658-afcf-033a9a8ef9fe", "name": "network-vif-plugged", "status": "completed", "tag": "18ae7b24-5975-46e7-908e-8cbd192f6d2f"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:37:44.382954 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:37:44.382954 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:37:44.390966 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-38c714ff-8984-419a-ba33-7c39e2e19f27 req-2d51a922-ed98-49fb-ba3e-063a6b907daf service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:44.391415 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-38c714ff-8984-419a-ba33-7c39e2e19f27 req-2d51a922-ed98-49fb-ba3e-063a6b907daf service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:44.402329 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-38c714ff-8984-419a-ba33-7c39e2e19f27 req-2d51a922-ed98-49fb-ba3e-063a6b907daf service nova] Creating event network-vif-plugged:18ae7b24-5975-46e7-908e-8cbd192f6d2f for instance f30691a4-e578-4658-afcf-033a9a8ef9fe on hv-cinder-80475 Nov 23 14:37:44.407274 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-38c714ff-8984-419a-ba33-7c39e2e19f27 req-2d51a922-ed98-49fb-ba3e-063a6b907daf service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029637 Nov 23 14:37:44.407855 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 482/973] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:37:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:37:44.477787 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-986640b3-4a71-4c05-97be-a4aba87493c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:44.478597 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-986640b3-4a71-4c05-97be-a4aba87493c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:44.484642 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-986640b3-4a71-4c05-97be-a4aba87493c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:44.485091 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-986640b3-4a71-4c05-97be-a4aba87493c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:44.485863 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-986640b3-4a71-4c05-97be-a4aba87493c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:44.486286 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-986640b3-4a71-4c05-97be-a4aba87493c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:44.619209 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-986640b3-4a71-4c05-97be-a4aba87493c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:44.626436 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-986640b3-4a71-4c05-97be-a4aba87493c1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.153173 Nov 23 14:37:44.627004 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 492/974] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:44 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:44.811251 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3d301547-a9d9-4c05-aae4-c870c832799a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:44.811942 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3d301547-a9d9-4c05-aae4-c870c832799a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:44.818089 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3d301547-a9d9-4c05-aae4-c870c832799a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:44.818534 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3d301547-a9d9-4c05-aae4-c870c832799a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:44.819354 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3d301547-a9d9-4c05-aae4-c870c832799a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:44.819786 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3d301547-a9d9-4c05-aae4-c870c832799a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:44.947173 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3d301547-a9d9-4c05-aae4-c870c832799a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:44.954200 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3d301547-a9d9-4c05-aae4-c870c832799a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.146988 Nov 23 14:37:44.954758 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 483/975] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:44 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:37:45.643662 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-63ba9252-7d43-44d0-ba10-59dd8a9893e3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:45.644182 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-63ba9252-7d43-44d0-ba10-59dd8a9893e3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:45.651110 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-63ba9252-7d43-44d0-ba10-59dd8a9893e3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:45.651559 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-63ba9252-7d43-44d0-ba10-59dd8a9893e3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:45.652355 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-63ba9252-7d43-44d0-ba10-59dd8a9893e3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:45.652787 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-63ba9252-7d43-44d0-ba10-59dd8a9893e3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:45.779940 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-63ba9252-7d43-44d0-ba10-59dd8a9893e3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:45.787100 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-63ba9252-7d43-44d0-ba10-59dd8a9893e3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.147151 Nov 23 14:37:45.787663 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 493/976] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:45 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:45.970960 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-461187c2-5d65-4459-846d-1561be1f6122 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:45.971570 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-461187c2-5d65-4459-846d-1561be1f6122 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:45.977985 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-461187c2-5d65-4459-846d-1561be1f6122 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:45.978456 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-461187c2-5d65-4459-846d-1561be1f6122 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:45.979234 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-461187c2-5d65-4459-846d-1561be1f6122 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:45.979672 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-461187c2-5d65-4459-846d-1561be1f6122 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:46.114065 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-461187c2-5d65-4459-846d-1561be1f6122 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:46.122324 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-461187c2-5d65-4459-846d-1561be1f6122 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1357 microversion: 2.1 time: 0.155109 Nov 23 14:37:46.122896 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 484/977] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:45 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:46.804695 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d77b9195-2cf8-4da7-8fac-c0f15c18c876 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:46.805410 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d77b9195-2cf8-4da7-8fac-c0f15c18c876 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:46.811794 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d77b9195-2cf8-4da7-8fac-c0f15c18c876 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:46.812272 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d77b9195-2cf8-4da7-8fac-c0f15c18c876 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:46.813022 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d77b9195-2cf8-4da7-8fac-c0f15c18c876 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:46.813448 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d77b9195-2cf8-4da7-8fac-c0f15c18c876 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:46.941241 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d77b9195-2cf8-4da7-8fac-c0f15c18c876 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:46.949212 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d77b9195-2cf8-4da7-8fac-c0f15c18c876 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.148159 Nov 23 14:37:46.949773 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 494/978] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:46 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:47.139485 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6c4d2408-d9c0-426f-841a-d5be3a5d6133 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:47.140017 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6c4d2408-d9c0-426f-841a-d5be3a5d6133 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:47.146203 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c4d2408-d9c0-426f-841a-d5be3a5d6133 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:47.146651 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c4d2408-d9c0-426f-841a-d5be3a5d6133 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:47.147424 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c4d2408-d9c0-426f-841a-d5be3a5d6133 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:47.147860 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c4d2408-d9c0-426f-841a-d5be3a5d6133 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:47.275658 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6c4d2408-d9c0-426f-841a-d5be3a5d6133 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:47.282815 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6c4d2408-d9c0-426f-841a-d5be3a5d6133 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1548 microversion: 2.1 time: 0.147021 Nov 23 14:37:47.283374 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 485/979] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:47 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:47.299514 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-99080a1a-629c-432c-baf0-45628de0a478 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:47.311029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-99080a1a-629c-432c-baf0-45628de0a478 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:47.311029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-99080a1a-629c-432c-baf0-45628de0a478 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:47.311029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-99080a1a-629c-432c-baf0-45628de0a478 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:47.311029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-99080a1a-629c-432c-baf0-45628de0a478 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:47.311423 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-99080a1a-629c-432c-baf0-45628de0a478 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:47.436718 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-99080a1a-629c-432c-baf0-45628de0a478 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:47.443937 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-99080a1a-629c-432c-baf0-45628de0a478 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1548 microversion: 2.1 time: 0.148118 Nov 23 14:37:47.444540 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 495/980] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:47 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:47.460478 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9a03c8a2-6150-48a7-8c0a-c57ca57dffef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:47.464475 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:37:47.464475 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:37:47.465453 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9a03c8a2-6150-48a7-8c0a-c57ca57dffef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:47.466190 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9a03c8a2-6150-48a7-8c0a-c57ca57dffef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Searching by: {'deleted': False, 'project_id': '3c896e07f31448e08e2af756467d627d'} {{(pid=116787) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 23 14:37:47.472607 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9a03c8a2-6150-48a7-8c0a-c57ca57dffef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:47.473058 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9a03c8a2-6150-48a7-8c0a-c57ca57dffef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:47.473861 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9a03c8a2-6150-48a7-8c0a-c57ca57dffef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:47.474301 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9a03c8a2-6150-48a7-8c0a-c57ca57dffef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:47.562125 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.multi_cell_list [None req-9a03c8a2-6150-48a7-8c0a-c57ca57dffef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 23 14:37:47.656435 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9a03c8a2-6150-48a7-8c0a-c57ca57dffef tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.199515 Nov 23 14:37:47.657018 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 486/981] 10.222.0.82 () {58 vars in 1124 bytes} [Tue Nov 23 14:37:47 2021] GET /compute/v2.1/servers => generated 342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:37:47.667095 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ec38c3bf-9f1b-4b28-ad6e-255dbde6d377 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:47.667691 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ec38c3bf-9f1b-4b28-ad6e-255dbde6d377 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:47.673461 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ec38c3bf-9f1b-4b28-ad6e-255dbde6d377 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:47.673934 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ec38c3bf-9f1b-4b28-ad6e-255dbde6d377 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:47.674696 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ec38c3bf-9f1b-4b28-ad6e-255dbde6d377 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:47.675122 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ec38c3bf-9f1b-4b28-ad6e-255dbde6d377 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:47.802225 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ec38c3bf-9f1b-4b28-ad6e-255dbde6d377 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:47.810782 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ec38c3bf-9f1b-4b28-ad6e-255dbde6d377 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1548 microversion: 2.1 time: 0.147416 Nov 23 14:37:47.811409 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 496/982] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:47 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:47.966192 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0feebfc2-3234-4678-a5b9-12f5c0ad0901 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:47.966964 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0feebfc2-3234-4678-a5b9-12f5c0ad0901 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:47.972739 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0feebfc2-3234-4678-a5b9-12f5c0ad0901 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:47.973196 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0feebfc2-3234-4678-a5b9-12f5c0ad0901 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:47.973965 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0feebfc2-3234-4678-a5b9-12f5c0ad0901 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:47.974407 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0feebfc2-3234-4678-a5b9-12f5c0ad0901 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:48.104852 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0feebfc2-3234-4678-a5b9-12f5c0ad0901 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:48.112078 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0feebfc2-3234-4678-a5b9-12f5c0ad0901 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.149716 Nov 23 14:37:48.112671 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 487/983] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:47 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:49.129100 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bc3f81e9-f2e1-4e59-84eb-d9899356c40d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:49.129759 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bc3f81e9-f2e1-4e59-84eb-d9899356c40d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:49.136932 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bc3f81e9-f2e1-4e59-84eb-d9899356c40d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:49.137374 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bc3f81e9-f2e1-4e59-84eb-d9899356c40d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:49.138143 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bc3f81e9-f2e1-4e59-84eb-d9899356c40d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:49.138568 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bc3f81e9-f2e1-4e59-84eb-d9899356c40d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:49.278043 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-bc3f81e9-f2e1-4e59-84eb-d9899356c40d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:49.285442 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bc3f81e9-f2e1-4e59-84eb-d9899356c40d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.160014 Nov 23 14:37:49.286009 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 497/984] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:49 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:49.519922 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1341bd23-d76f-44fb-99d5-6bb51147c8c5 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4556a7e1-1742-4fbd-a5f2-c0beb0f9ee9b"}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:37:49.521004 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1341bd23-d76f-44fb-99d5-6bb51147c8c5 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:49.527125 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1341bd23-d76f-44fb-99d5-6bb51147c8c5 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:49.527521 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1341bd23-d76f-44fb-99d5-6bb51147c8c5 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:49.528312 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1341bd23-d76f-44fb-99d5-6bb51147c8c5 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:49.528747 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1341bd23-d76f-44fb-99d5-6bb51147c8c5 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:50.223923 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1341bd23-d76f-44fb-99d5-6bb51147c8c5 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "POST /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.707479 Nov 23 14:37:50.224696 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 488/985] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Nov 23 14:37:49 2021] POST /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/os-volume_attachments => generated 194 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:37:50.302022 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3aecb2db-3d44-44f1-8b2b-b4d4126f4ab2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:50.302619 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3aecb2db-3d44-44f1-8b2b-b4d4126f4ab2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:50.309499 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3aecb2db-3d44-44f1-8b2b-b4d4126f4ab2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:50.310558 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3aecb2db-3d44-44f1-8b2b-b4d4126f4ab2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:50.311491 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3aecb2db-3d44-44f1-8b2b-b4d4126f4ab2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:50.311937 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3aecb2db-3d44-44f1-8b2b-b4d4126f4ab2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:50.449262 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-3aecb2db-3d44-44f1-8b2b-b4d4126f4ab2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:50.456599 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3aecb2db-3d44-44f1-8b2b-b4d4126f4ab2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.158206 Nov 23 14:37:50.457170 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 498/986] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:50 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:51.475570 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5ebedc1f-ad6b-4233-96d3-3e705bd8874d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:51.476767 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5ebedc1f-ad6b-4233-96d3-3e705bd8874d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:51.482917 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5ebedc1f-ad6b-4233-96d3-3e705bd8874d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:51.483361 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5ebedc1f-ad6b-4233-96d3-3e705bd8874d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:51.484119 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5ebedc1f-ad6b-4233-96d3-3e705bd8874d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:51.484569 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5ebedc1f-ad6b-4233-96d3-3e705bd8874d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:51.617543 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5ebedc1f-ad6b-4233-96d3-3e705bd8874d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:51.624647 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5ebedc1f-ad6b-4233-96d3-3e705bd8874d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.153541 Nov 23 14:37:51.625216 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 489/987] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:51 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:52.641821 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-389f7ce6-f13d-4d5f-9c94-6af29d740121 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:52.642421 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-389f7ce6-f13d-4d5f-9c94-6af29d740121 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:52.649443 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-389f7ce6-f13d-4d5f-9c94-6af29d740121 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:52.649911 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-389f7ce6-f13d-4d5f-9c94-6af29d740121 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:52.650683 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-389f7ce6-f13d-4d5f-9c94-6af29d740121 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:52.651107 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-389f7ce6-f13d-4d5f-9c94-6af29d740121 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:52.780945 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-389f7ce6-f13d-4d5f-9c94-6af29d740121 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:52.788123 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-389f7ce6-f13d-4d5f-9c94-6af29d740121 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.150054 Nov 23 14:37:52.789280 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 499/988] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:52 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:53.806050 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-51bba91b-3f89-431e-a894-07a786bbee84 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:53.806650 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-51bba91b-3f89-431e-a894-07a786bbee84 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:53.812747 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-51bba91b-3f89-431e-a894-07a786bbee84 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:53.813193 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-51bba91b-3f89-431e-a894-07a786bbee84 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:53.813956 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-51bba91b-3f89-431e-a894-07a786bbee84 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:53.814381 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-51bba91b-3f89-431e-a894-07a786bbee84 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:53.942464 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-51bba91b-3f89-431e-a894-07a786bbee84 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:53.950451 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-51bba91b-3f89-431e-a894-07a786bbee84 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.148529 Nov 23 14:37:53.951043 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 490/989] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:53 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:54.776755 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-644eb58c-bfed-4c53-83f7-605f23c08b91 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:54.777307 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-644eb58c-bfed-4c53-83f7-605f23c08b91 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:54.783380 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-644eb58c-bfed-4c53-83f7-605f23c08b91 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:54.783817 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-644eb58c-bfed-4c53-83f7-605f23c08b91 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:54.784610 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-644eb58c-bfed-4c53-83f7-605f23c08b91 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:54.785040 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-644eb58c-bfed-4c53-83f7-605f23c08b91 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:54.813034 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-644eb58c-bfed-4c53-83f7-605f23c08b91 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-volume_attachments/514f6112-4c3c-43e6-8693-0ef793dc5744" status: 200 len: 194 microversion: 2.20 time: 0.040698 Nov 23 14:37:54.813592 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 500/990] 10.222.0.82 () {60 vars in 1453 bytes} [Tue Nov 23 14:37:54 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-volume_attachments/514f6112-4c3c-43e6-8693-0ef793dc5744 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:37:54.871796 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c5bc07d6-ef1d-46bf-b66b-fb6ca92a22a1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:54.872303 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c5bc07d6-ef1d-46bf-b66b-fb6ca92a22a1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:54.878356 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c5bc07d6-ef1d-46bf-b66b-fb6ca92a22a1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:54.878838 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c5bc07d6-ef1d-46bf-b66b-fb6ca92a22a1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:54.879614 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c5bc07d6-ef1d-46bf-b66b-fb6ca92a22a1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:54.880048 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c5bc07d6-ef1d-46bf-b66b-fb6ca92a22a1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:54.955230 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-c5bc07d6-ef1d-46bf-b66b-fb6ca92a22a1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lazy-loading 'services' on Instance uuid f5c8dbd0-2f80-4158-923b-24f263fd9832 {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:37:54.967666 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-0280bdce-e375-4e1c-b422-80db94bae62a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:54.968430 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-0280bdce-e375-4e1c-b422-80db94bae62a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:54.974375 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0280bdce-e375-4e1c-b422-80db94bae62a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:54.974895 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0280bdce-e375-4e1c-b422-80db94bae62a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:54.975667 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0280bdce-e375-4e1c-b422-80db94bae62a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:54.976766 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0280bdce-e375-4e1c-b422-80db94bae62a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:55.108605 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-0280bdce-e375-4e1c-b422-80db94bae62a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:55.115877 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-0280bdce-e375-4e1c-b422-80db94bae62a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.151859 Nov 23 14:37:55.117210 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 501/991] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:54 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:37:55.133583 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c5bc07d6-ef1d-46bf-b66b-fb6ca92a22a1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "DELETE /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-volume_attachments/514f6112-4c3c-43e6-8693-0ef793dc5744" status: 202 len: 0 microversion: 2.20 time: 0.264933 Nov 23 14:37:55.134255 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 491/992] 10.222.0.82 () {60 vars in 1456 bytes} [Tue Nov 23 14:37:54 2021] DELETE /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-volume_attachments/514f6112-4c3c-43e6-8693-0ef793dc5744 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 14:37:55.143615 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1e81f957-ed9f-44e5-9562-f04fe2111a4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:55.144552 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1e81f957-ed9f-44e5-9562-f04fe2111a4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:55.151284 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1e81f957-ed9f-44e5-9562-f04fe2111a4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:55.151735 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1e81f957-ed9f-44e5-9562-f04fe2111a4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:55.152652 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1e81f957-ed9f-44e5-9562-f04fe2111a4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:55.153167 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1e81f957-ed9f-44e5-9562-f04fe2111a4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:55.184259 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1e81f957-ed9f-44e5-9562-f04fe2111a4f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045540 Nov 23 14:37:55.184830 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 502/993] 10.222.0.82 () {60 vars in 1342 bytes} [Tue Nov 23 14:37:55 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:37:56.135900 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-71ba9992-b5a8-4976-b1b6-c50515b57e80 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:56.136631 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-71ba9992-b5a8-4976-b1b6-c50515b57e80 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:56.142582 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-71ba9992-b5a8-4976-b1b6-c50515b57e80 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:56.143027 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-71ba9992-b5a8-4976-b1b6-c50515b57e80 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:56.143796 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-71ba9992-b5a8-4976-b1b6-c50515b57e80 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:56.144230 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-71ba9992-b5a8-4976-b1b6-c50515b57e80 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:56.195478 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-78bdccb6-79fd-48da-aa70-b3fdc59c878f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:56.196429 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-78bdccb6-79fd-48da-aa70-b3fdc59c878f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:56.202725 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-78bdccb6-79fd-48da-aa70-b3fdc59c878f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:56.203174 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-78bdccb6-79fd-48da-aa70-b3fdc59c878f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:56.203989 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-78bdccb6-79fd-48da-aa70-b3fdc59c878f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:56.204459 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-78bdccb6-79fd-48da-aa70-b3fdc59c878f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:56.233873 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-78bdccb6-79fd-48da-aa70-b3fdc59c878f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042761 Nov 23 14:37:56.234445 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 503/994] 10.222.0.82 () {60 vars in 1342 bytes} [Tue Nov 23 14:37:56 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:37:56.275989 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-71ba9992-b5a8-4976-b1b6-c50515b57e80 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:56.283243 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-71ba9992-b5a8-4976-b1b6-c50515b57e80 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.152618 Nov 23 14:37:56.283732 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 492/995] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:56 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:57.245624 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-fb5878cf-dcce-4227-a2fb-25014d84b2d6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:57.246502 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-fb5878cf-dcce-4227-a2fb-25014d84b2d6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:57.252671 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fb5878cf-dcce-4227-a2fb-25014d84b2d6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:57.253114 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fb5878cf-dcce-4227-a2fb-25014d84b2d6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:57.253876 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fb5878cf-dcce-4227-a2fb-25014d84b2d6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:57.254305 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fb5878cf-dcce-4227-a2fb-25014d84b2d6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:57.284025 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-fb5878cf-dcce-4227-a2fb-25014d84b2d6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042293 Nov 23 14:37:57.284602 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 504/996] 10.222.0.82 () {60 vars in 1342 bytes} [Tue Nov 23 14:37:57 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:37:57.300456 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8e88b553-322e-421c-81bd-81441d30dcc9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:57.301070 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8e88b553-322e-421c-81bd-81441d30dcc9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:57.307652 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8e88b553-322e-421c-81bd-81441d30dcc9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:57.308105 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8e88b553-322e-421c-81bd-81441d30dcc9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:57.308936 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8e88b553-322e-421c-81bd-81441d30dcc9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:57.309369 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8e88b553-322e-421c-81bd-81441d30dcc9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:57.437916 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-8e88b553-322e-421c-81bd-81441d30dcc9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:57.445688 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8e88b553-322e-421c-81bd-81441d30dcc9 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.149171 Nov 23 14:37:57.446256 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 493/997] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:57 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:57.739586 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7ff532e3-7667-47fb-85fb-49d316a16255 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:57.740192 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7ff532e3-7667-47fb-85fb-49d316a16255 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:57.746849 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ff532e3-7667-47fb-85fb-49d316a16255 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:57.747293 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ff532e3-7667-47fb-85fb-49d316a16255 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:57.748058 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ff532e3-7667-47fb-85fb-49d316a16255 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:57.748510 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7ff532e3-7667-47fb-85fb-49d316a16255 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:57.881601 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7ff532e3-7667-47fb-85fb-49d316a16255 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:57.890249 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7ff532e3-7667-47fb-85fb-49d316a16255 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1594 microversion: 2.1 time: 0.154341 Nov 23 14:37:57.890806 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 505/998] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:57 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:58.297073 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d4ccdeeb-9056-4ea7-86c4-b4bbee88c9af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:58.298139 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d4ccdeeb-9056-4ea7-86c4-b4bbee88c9af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:58.305962 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d4ccdeeb-9056-4ea7-86c4-b4bbee88c9af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:58.306626 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d4ccdeeb-9056-4ea7-86c4-b4bbee88c9af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:58.307368 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d4ccdeeb-9056-4ea7-86c4-b4bbee88c9af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:58.307872 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d4ccdeeb-9056-4ea7-86c4-b4bbee88c9af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:58.340151 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d4ccdeeb-9056-4ea7-86c4-b4bbee88c9af tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048108 Nov 23 14:37:58.340653 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 494/999] 10.222.0.82 () {60 vars in 1342 bytes} [Tue Nov 23 14:37:58 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:37:58.463296 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e4898fb8-71dd-4f9d-82c8-2c85b09c1c5e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:58.463905 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e4898fb8-71dd-4f9d-82c8-2c85b09c1c5e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:58.470722 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e4898fb8-71dd-4f9d-82c8-2c85b09c1c5e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:58.471167 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e4898fb8-71dd-4f9d-82c8-2c85b09c1c5e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:58.471950 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e4898fb8-71dd-4f9d-82c8-2c85b09c1c5e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:58.472415 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e4898fb8-71dd-4f9d-82c8-2c85b09c1c5e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:58.630420 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e4898fb8-71dd-4f9d-82c8-2c85b09c1c5e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:58.638611 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e4898fb8-71dd-4f9d-82c8-2c85b09c1c5e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.179727 Nov 23 14:37:58.639178 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 506/1000] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:58 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:59.351263 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-24f12bd8-d15f-4465-922f-c0fae7a446e8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:59.352848 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-24f12bd8-d15f-4465-922f-c0fae7a446e8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:59.360885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-24f12bd8-d15f-4465-922f-c0fae7a446e8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:59.361330 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-24f12bd8-d15f-4465-922f-c0fae7a446e8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:59.363009 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-24f12bd8-d15f-4465-922f-c0fae7a446e8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:59.363610 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-24f12bd8-d15f-4465-922f-c0fae7a446e8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:59.397340 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-24f12bd8-d15f-4465-922f-c0fae7a446e8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049757 Nov 23 14:37:59.402950 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 495/1001] 10.222.0.82 () {60 vars in 1342 bytes} [Tue Nov 23 14:37:59 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:37:59.456927 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-149dd8ed-e22a-455a-8fc2-b5d80542b7a0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:59.457406 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-149dd8ed-e22a-455a-8fc2-b5d80542b7a0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:59.464275 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-149dd8ed-e22a-455a-8fc2-b5d80542b7a0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:59.464936 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-149dd8ed-e22a-455a-8fc2-b5d80542b7a0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:59.465508 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-149dd8ed-e22a-455a-8fc2-b5d80542b7a0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:59.465934 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-149dd8ed-e22a-455a-8fc2-b5d80542b7a0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:59.493134 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-149dd8ed-e22a-455a-8fc2-b5d80542b7a0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Going to try to terminate instance {{(pid=116788) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:37:59.656104 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ae5fba8f-a09c-4478-91e1-79a6c63f5c3d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:59.656773 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ae5fba8f-a09c-4478-91e1-79a6c63f5c3d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:59.662605 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ae5fba8f-a09c-4478-91e1-79a6c63f5c3d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:59.663170 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ae5fba8f-a09c-4478-91e1-79a6c63f5c3d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:59.664033 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ae5fba8f-a09c-4478-91e1-79a6c63f5c3d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:59.664740 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ae5fba8f-a09c-4478-91e1-79a6c63f5c3d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:59.801328 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ae5fba8f-a09c-4478-91e1-79a6c63f5c3d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:59.809362 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ae5fba8f-a09c-4478-91e1-79a6c63f5c3d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.156990 Nov 23 14:37:59.809932 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 496/1002] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:37:59 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:37:59.824219 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-149dd8ed-e22a-455a-8fc2-b5d80542b7a0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "DELETE /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 204 len: 0 microversion: 2.20 time: 0.370658 Nov 23 14:37:59.824905 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 507/1003] 10.222.0.82 () {60 vars in 1279 bytes} [Tue Nov 23 14:37:59 2021] DELETE /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 23 14:37:59.833104 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ea9da49b-150f-48a5-9f36-6968b08a5009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:37:59.833760 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ea9da49b-150f-48a5-9f36-6968b08a5009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:37:59.840021 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ea9da49b-150f-48a5-9f36-6968b08a5009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:59.840509 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ea9da49b-150f-48a5-9f36-6968b08a5009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:59.841274 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ea9da49b-150f-48a5-9f36-6968b08a5009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:37:59.841701 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ea9da49b-150f-48a5-9f36-6968b08a5009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:37:59.971112 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ea9da49b-150f-48a5-9f36-6968b08a5009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:59.978774 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ea9da49b-150f-48a5-9f36-6968b08a5009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:59.980287 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ea9da49b-150f-48a5-9f36-6968b08a5009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:37:59.981436 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ea9da49b-150f-48a5-9f36-6968b08a5009 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.152128 Nov 23 14:37:59.981997 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 497/1004] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:37:59 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:38:00.241188 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-54d14ac4-338a-43a4-b4b6-48ef3d58305f req-ea59f4a0-30d4-4fe1-a02a-f861c1f19495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f30691a4-e578-4658-afcf-033a9a8ef9fe", "tag": "18ae7b24-5975-46e7-908e-8cbd192f6d2f"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:00.242734 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:38:00.242734 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:38:00.249543 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-54d14ac4-338a-43a4-b4b6-48ef3d58305f req-ea59f4a0-30d4-4fe1-a02a-f861c1f19495 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:00.250231 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-54d14ac4-338a-43a4-b4b6-48ef3d58305f req-ea59f4a0-30d4-4fe1-a02a-f861c1f19495 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:00.263329 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-54d14ac4-338a-43a4-b4b6-48ef3d58305f req-ea59f4a0-30d4-4fe1-a02a-f861c1f19495 service nova] Creating event network-changed:18ae7b24-5975-46e7-908e-8cbd192f6d2f for instance f30691a4-e578-4658-afcf-033a9a8ef9fe on hv-cinder-80475 Nov 23 14:38:00.268514 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-54d14ac4-338a-43a4-b4b6-48ef3d58305f req-ea59f4a0-30d4-4fe1-a02a-f861c1f19495 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151380 Nov 23 14:38:00.269691 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 508/1005] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:38:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:38:00.826269 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b4dc0d18-8390-4700-95a1-334473cb4e41 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:00.827595 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b4dc0d18-8390-4700-95a1-334473cb4e41 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:00.834797 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b4dc0d18-8390-4700-95a1-334473cb4e41 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:00.835253 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b4dc0d18-8390-4700-95a1-334473cb4e41 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:00.836050 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b4dc0d18-8390-4700-95a1-334473cb4e41 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:00.836616 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b4dc0d18-8390-4700-95a1-334473cb4e41 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:01.002022 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d2db587f-ae25-4651-9efd-ee34909a48b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:01.002510 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d2db587f-ae25-4651-9efd-ee34909a48b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:01.010568 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d2db587f-ae25-4651-9efd-ee34909a48b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:01.012682 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d2db587f-ae25-4651-9efd-ee34909a48b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:01.013632 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d2db587f-ae25-4651-9efd-ee34909a48b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:01.014163 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d2db587f-ae25-4651-9efd-ee34909a48b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:01.015642 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-b4dc0d18-8390-4700-95a1-334473cb4e41 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:01.025996 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b4dc0d18-8390-4700-95a1-334473cb4e41 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.203398 Nov 23 14:38:01.026787 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 498/1006] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:00 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:38:01.159579 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d2db587f-ae25-4651-9efd-ee34909a48b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:01.169209 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d2db587f-ae25-4651-9efd-ee34909a48b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:01.170710 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d2db587f-ae25-4651-9efd-ee34909a48b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:01.171883 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d2db587f-ae25-4651-9efd-ee34909a48b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.174322 Nov 23 14:38:01.177725 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 509/1007] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:38:00 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:38:02.043652 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b3d624a0-4aec-4306-9ab4-944982ff534c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:02.044364 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b3d624a0-4aec-4306-9ab4-944982ff534c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:02.050538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b3d624a0-4aec-4306-9ab4-944982ff534c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:02.051375 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b3d624a0-4aec-4306-9ab4-944982ff534c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:02.052179 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b3d624a0-4aec-4306-9ab4-944982ff534c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:02.052649 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b3d624a0-4aec-4306-9ab4-944982ff534c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:02.195462 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e44b55ff-4648-42f8-a0c7-6e45d88d0ca6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:02.196082 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e44b55ff-4648-42f8-a0c7-6e45d88d0ca6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:02.203961 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e44b55ff-4648-42f8-a0c7-6e45d88d0ca6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:02.204725 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e44b55ff-4648-42f8-a0c7-6e45d88d0ca6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:02.205739 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e44b55ff-4648-42f8-a0c7-6e45d88d0ca6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:02.206346 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e44b55ff-4648-42f8-a0c7-6e45d88d0ca6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:02.452043 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-b3d624a0-4aec-4306-9ab4-944982ff534c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:02.458932 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b3d624a0-4aec-4306-9ab4-944982ff534c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.418873 Nov 23 14:38:02.459513 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 499/1008] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:02 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:02.683049 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e44b55ff-4648-42f8-a0c7-6e45d88d0ca6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:02.690689 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e44b55ff-4648-42f8-a0c7-6e45d88d0ca6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:02.692577 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e44b55ff-4648-42f8-a0c7-6e45d88d0ca6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:02.694602 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e44b55ff-4648-42f8-a0c7-6e45d88d0ca6 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1723 microversion: 2.20 time: 0.502750 Nov 23 14:38:02.695188 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 510/1009] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:38:02 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1723 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:38:02.714986 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9afefabc-31ae-4634-aa6d-041095575ee4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-770874200"}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:02.715845 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9afefabc-31ae-4634-aa6d-041095575ee4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:02.721356 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9afefabc-31ae-4634-aa6d-041095575ee4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:02.721877 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9afefabc-31ae-4634-aa6d-041095575ee4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:02.722655 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9afefabc-31ae-4634-aa6d-041095575ee4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:02.723090 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9afefabc-31ae-4634-aa6d-041095575ee4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:02.863835 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.network.security_group_api [None req-9afefabc-31ae-4634-aa6d-041095575ee4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Adding security group 7f0a13f9-2db1-41e4-a272-ab01fe473a9f to port 18ae7b24-5975-46e7-908e-8cbd192f6d2f Nov 23 14:38:03.281628 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9afefabc-31ae-4634-aa6d-041095575ee4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "POST /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/action" status: 202 len: 0 microversion: 2.1 time: 0.570221 Nov 23 14:38:03.285344 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 500/1010] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:38:02 2021] POST /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:03.290338 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-fd8789f7-a833-4455-83bb-aef885fb7617 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:03.290960 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-fd8789f7-a833-4455-83bb-aef885fb7617 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:03.299427 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fd8789f7-a833-4455-83bb-aef885fb7617 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:03.301412 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fd8789f7-a833-4455-83bb-aef885fb7617 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:03.308754 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-c6a48a92-7d0a-443c-8692-8aa4aeaa6014 req-07c0e6f6-9e89-4daa-ae4a-d8f4ca65d69f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f30691a4-e578-4658-afcf-033a9a8ef9fe", "tag": "18ae7b24-5975-46e7-908e-8cbd192f6d2f"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:03.310221 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:38:03.310221 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:38:03.316577 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fd8789f7-a833-4455-83bb-aef885fb7617 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:03.317339 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fd8789f7-a833-4455-83bb-aef885fb7617 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:03.330303 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-c6a48a92-7d0a-443c-8692-8aa4aeaa6014 req-07c0e6f6-9e89-4daa-ae4a-d8f4ca65d69f service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:03.337523 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-c6a48a92-7d0a-443c-8692-8aa4aeaa6014 req-07c0e6f6-9e89-4daa-ae4a-d8f4ca65d69f service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:03.355705 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-c6a48a92-7d0a-443c-8692-8aa4aeaa6014 req-07c0e6f6-9e89-4daa-ae4a-d8f4ca65d69f service nova] Creating event network-changed:18ae7b24-5975-46e7-908e-8cbd192f6d2f for instance f30691a4-e578-4658-afcf-033a9a8ef9fe on hv-cinder-80475 Nov 23 14:38:03.362779 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-c6a48a92-7d0a-443c-8692-8aa4aeaa6014 req-07c0e6f6-9e89-4daa-ae4a-d8f4ca65d69f service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058208 Nov 23 14:38:03.363384 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 501/1011] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:38:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:38:03.379650 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-b923dd22-1c8e-4433-86f0-1a5567128b39 req-bc27ba19-d19c-4dfe-8bf8-386a734917ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c8dbd0-2f80-4158-923b-24f263fd9832", "name": "network-vif-deleted", "tag": "643c4469-7e07-47b2-806d-0dfc74abe378"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:03.381787 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:38:03.381787 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:38:03.398534 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-b923dd22-1c8e-4433-86f0-1a5567128b39 req-bc27ba19-d19c-4dfe-8bf8-386a734917ea service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:03.398534 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-b923dd22-1c8e-4433-86f0-1a5567128b39 req-bc27ba19-d19c-4dfe-8bf8-386a734917ea service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:03.426613 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-b923dd22-1c8e-4433-86f0-1a5567128b39 req-bc27ba19-d19c-4dfe-8bf8-386a734917ea service nova] Creating event network-vif-deleted:643c4469-7e07-47b2-806d-0dfc74abe378 for instance f5c8dbd0-2f80-4158-923b-24f263fd9832 on hv-cinder-80475 Nov 23 14:38:03.437491 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-b923dd22-1c8e-4433-86f0-1a5567128b39 req-bc27ba19-d19c-4dfe-8bf8-386a734917ea service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072267 Nov 23 14:38:03.438026 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 502/1012] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:38:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:38:03.479357 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-bdfc802f-2350-45b1-aad7-18bf294875a8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:03.480404 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-bdfc802f-2350-45b1-aad7-18bf294875a8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:03.503466 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bdfc802f-2350-45b1-aad7-18bf294875a8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:03.503934 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bdfc802f-2350-45b1-aad7-18bf294875a8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:03.504792 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bdfc802f-2350-45b1-aad7-18bf294875a8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:03.512672 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bdfc802f-2350-45b1-aad7-18bf294875a8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:03.736052 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-fd8789f7-a833-4455-83bb-aef885fb7617 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:03.739946 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-bdfc802f-2350-45b1-aad7-18bf294875a8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:03.754836 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-bdfc802f-2350-45b1-aad7-18bf294875a8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1678 microversion: 2.1 time: 0.281045 Nov 23 14:38:03.755251 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 503/1013] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:03 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1678 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:38:03.757722 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-fd8789f7-a833-4455-83bb-aef885fb7617 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1759 microversion: 2.1 time: 0.470765 Nov 23 14:38:03.763189 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 511/1014] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:03 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1759 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:03.763776 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-590a3589-ced6-4d1e-912f-003c25ea1a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:03.764600 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-590a3589-ced6-4d1e-912f-003c25ea1a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:03.772998 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-590a3589-ced6-4d1e-912f-003c25ea1a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:03.773702 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-590a3589-ced6-4d1e-912f-003c25ea1a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:03.774666 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-590a3589-ced6-4d1e-912f-003c25ea1a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:03.775279 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-590a3589-ced6-4d1e-912f-003c25ea1a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:03.810886 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-590a3589-ced6-4d1e-912f-003c25ea1a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:03.811607 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-590a3589-ced6-4d1e-912f-003c25ea1a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:03.812068 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-590a3589-ced6-4d1e-912f-003c25ea1a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lazy-loading 'fault' on Instance uuid f5c8dbd0-2f80-4158-923b-24f263fd9832 {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:38:03.858411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-590a3589-ced6-4d1e-912f-003c25ea1a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:03.870933 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-590a3589-ced6-4d1e-912f-003c25ea1a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:03.872510 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-590a3589-ced6-4d1e-912f-003c25ea1a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:03.873677 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-590a3589-ced6-4d1e-912f-003c25ea1a8e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 200 len: 1371 microversion: 2.20 time: 0.114839 Nov 23 14:38:03.874235 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 504/1015] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:38:03 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:38:04.773646 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5d033778-cc6f-4872-a916-38b15cfac760 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:04.774263 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5d033778-cc6f-4872-a916-38b15cfac760 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:04.781138 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5d033778-cc6f-4872-a916-38b15cfac760 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:04.781728 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5d033778-cc6f-4872-a916-38b15cfac760 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:04.782630 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5d033778-cc6f-4872-a916-38b15cfac760 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:04.783151 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5d033778-cc6f-4872-a916-38b15cfac760 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:04.895516 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e29f4fd4-83d6-4748-8fbf-37a593cf434c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:04.896759 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e29f4fd4-83d6-4748-8fbf-37a593cf434c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:04.903260 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e29f4fd4-83d6-4748-8fbf-37a593cf434c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:04.903723 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e29f4fd4-83d6-4748-8fbf-37a593cf434c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:04.904674 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e29f4fd4-83d6-4748-8fbf-37a593cf434c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:04.905164 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e29f4fd4-83d6-4748-8fbf-37a593cf434c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:04.922045 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-e29f4fd4-83d6-4748-8fbf-37a593cf434c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] HTTP exception thrown: Instance f5c8dbd0-2f80-4158-923b-24f263fd9832 could not be found. Nov 23 14:38:04.922903 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e29f4fd4-83d6-4748-8fbf-37a593cf434c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Returning 404 to user: Instance f5c8dbd0-2f80-4158-923b-24f263fd9832 could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:38:04.924184 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e29f4fd4-83d6-4748-8fbf-37a593cf434c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 404 len: 111 microversion: 2.20 time: 0.034824 Nov 23 14:38:04.925386 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 505/1016] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:38:04 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 23 14:38:04.934258 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5d033778-cc6f-4872-a916-38b15cfac760 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:04.936280 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f4439f55-d9d1-4276-8bc2-8190d5eab30d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '.version_select at 0x7f2082faf790>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:04.943132 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5d033778-cc6f-4872-a916-38b15cfac760 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1655 microversion: 2.1 time: 0.174769 Nov 23 14:38:04.944405 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 512/1017] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:04 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1655 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:38:04.960781 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bc66f4e8-9e6b-4371-bf89-a085c06c5f68 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:04.967187 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bc66f4e8-9e6b-4371-bf89-a085c06c5f68 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:04.967975 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bc66f4e8-9e6b-4371-bf89-a085c06c5f68 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:04.993893 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bc66f4e8-9e6b-4371-bf89-a085c06c5f68 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Going to try to start instance {{(pid=116788) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 23 14:38:05.025405 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f4439f55-d9d1-4276-8bc2-8190d5eab30d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-907714560" status: 204 len: 0 microversion: 2.20 time: 0.095292 Nov 23 14:38:05.026274 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 506/1018] 10.222.0.82 () {60 vars in 1258 bytes} [Tue Nov 23 14:38:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-907714560 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 23 14:38:05.170454 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bc66f4e8-9e6b-4371-bf89-a085c06c5f68 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action" status: 202 len: 0 microversion: 2.1 time: 0.213744 Nov 23 14:38:05.171086 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 513/1019] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:38:04 2021] POST /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:38:05.179052 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4817b68b-798a-4a54-8ddb-ac5214fe8227 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:05.179617 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4817b68b-798a-4a54-8ddb-ac5214fe8227 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:05.185634 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4817b68b-798a-4a54-8ddb-ac5214fe8227 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:05.186077 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4817b68b-798a-4a54-8ddb-ac5214fe8227 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:05.186866 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4817b68b-798a-4a54-8ddb-ac5214fe8227 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:05.187286 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4817b68b-798a-4a54-8ddb-ac5214fe8227 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:05.432117 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4817b68b-798a-4a54-8ddb-ac5214fe8227 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:05.440175 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4817b68b-798a-4a54-8ddb-ac5214fe8227 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1664 microversion: 2.1 time: 0.264842 Nov 23 14:38:05.440824 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 507/1020] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:05 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1664 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:06.010242 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7958eed7-2117-4235-a684-3b1604ad62b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'create', calling method: .version_select at 0x7f208268f040>, body: {"keypair": {"name": "tempest-keypair-1657160748"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:06.023465 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-7958eed7-2117-4235-a684-3b1604ad62b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Getting quotas for project 45e139a46b8d40e4a8a321403730eb71. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:38:06.027194 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-7958eed7-2117-4235-a684-3b1604ad62b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Getting quotas for user 641f2f7ca87d4245a59f2dbe7b98759a and project 45e139a46b8d40e4a8a321403730eb71. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:38:06.263564 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-7958eed7-2117-4235-a684-3b1604ad62b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Getting quotas for project 45e139a46b8d40e4a8a321403730eb71. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:38:06.267234 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-7958eed7-2117-4235-a684-3b1604ad62b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Getting quotas for user 641f2f7ca87d4245a59f2dbe7b98759a and project 45e139a46b8d40e4a8a321403730eb71. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:38:06.280501 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7958eed7-2117-4235-a684-3b1604ad62b7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.275680 Nov 23 14:38:06.281110 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 514/1021] 10.222.0.82 () {62 vars in 1198 bytes} [Tue Nov 23 14:38:06 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 277 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 23 14:38:06.458609 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3cb5a0f4-1bab-4da3-886e-3ed414f43a6c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:06.459918 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3cb5a0f4-1bab-4da3-886e-3ed414f43a6c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:06.466320 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3cb5a0f4-1bab-4da3-886e-3ed414f43a6c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:06.466771 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3cb5a0f4-1bab-4da3-886e-3ed414f43a6c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:06.467549 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3cb5a0f4-1bab-4da3-886e-3ed414f43a6c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:06.467986 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3cb5a0f4-1bab-4da3-886e-3ed414f43a6c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:06.626982 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3cb5a0f4-1bab-4da3-886e-3ed414f43a6c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:06.635398 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3cb5a0f4-1bab-4da3-886e-3ed414f43a6c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1664 microversion: 2.1 time: 0.180568 Nov 23 14:38:06.636222 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 508/1022] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:06 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1664 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:07.653768 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c9cd8259-9e19-4a72-8009-8bb3e7e6d84f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:07.654410 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c9cd8259-9e19-4a72-8009-8bb3e7e6d84f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:07.661070 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c9cd8259-9e19-4a72-8009-8bb3e7e6d84f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:07.663758 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c9cd8259-9e19-4a72-8009-8bb3e7e6d84f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:07.663758 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c9cd8259-9e19-4a72-8009-8bb3e7e6d84f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:07.663758 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c9cd8259-9e19-4a72-8009-8bb3e7e6d84f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:07.799213 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c9cd8259-9e19-4a72-8009-8bb3e7e6d84f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:07.807206 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c9cd8259-9e19-4a72-8009-8bb3e7e6d84f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1668 microversion: 2.1 time: 0.157676 Nov 23 14:38:07.807950 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 515/1023] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:07 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:08.472147 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3703c684-be49-49d2-ab46-5bb059cbc131 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-266037631", "imageRef": "b06b9241-c147-436d-86bb-7c49ad8ef09c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e99f3395-6821-450f-8990-3416439c902b"}], "security_groups": [{"name": "tempest-securitygroup--1538746930"}], "key_name": "tempest-keypair-1657160748", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:08.578409 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.network.neutron [None req-3703c684-be49-49d2-ab46-5bb059cbc131 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] validate_networks() for [('e99f3395-6821-450f-8990-3416439c902b', None, None, None, None, None)] {{(pid=116787) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:38:08.935041 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-3703c684-be49-49d2-ab46-5bb059cbc131 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Flavor limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:38:08.935480 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-3703c684-be49-49d2-ab46-5bb059cbc131 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Image limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:38:08.935944 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-3703c684-be49-49d2-ab46-5bb059cbc131 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Flavor pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:38:08.936370 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-3703c684-be49-49d2-ab46-5bb059cbc131 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Image pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:38:08.936773 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-3703c684-be49-49d2-ab46-5bb059cbc131 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:38:08.946504 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3703c684-be49-49d2-ab46-5bb059cbc131 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:08.946953 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3703c684-be49-49d2-ab46-5bb059cbc131 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:08.947756 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3703c684-be49-49d2-ab46-5bb059cbc131 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:08.948187 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3703c684-be49-49d2-ab46-5bb059cbc131 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:08.964295 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-3703c684-be49-49d2-ab46-5bb059cbc131 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Getting quotas for project 45e139a46b8d40e4a8a321403730eb71. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:38:08.968100 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-3703c684-be49-49d2-ab46-5bb059cbc131 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Getting quotas for user 641f2f7ca87d4245a59f2dbe7b98759a and project 45e139a46b8d40e4a8a321403730eb71. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:38:08.978735 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3703c684-be49-49d2-ab46-5bb059cbc131 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Going to run 1 instances... {{(pid=116787) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:38:08.981045 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3703c684-be49-49d2-ab46-5bb059cbc131 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b06b9241-c147-436d-86bb-7c49ad8ef09c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:38:09.128847 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3703c684-be49-49d2-ab46-5bb059cbc131 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.660344 Nov 23 14:38:09.129405 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 509/1024] 10.222.0.82 () {62 vars in 1187 bytes} [Tue Nov 23 14:38:08 2021] POST /compute/v2.1/servers => generated 402 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 23 14:38:09.140079 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-2efaea2c-98a9-4180-a1ba-d13b2c3490cf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:09.140726 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-2efaea2c-98a9-4180-a1ba-d13b2c3490cf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:09.193877 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-2efaea2c-98a9-4180-a1ba-d13b2c3490cf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:09.200777 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-2efaea2c-98a9-4180-a1ba-d13b2c3490cf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:09.202371 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-2efaea2c-98a9-4180-a1ba-d13b2c3490cf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:09.203540 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-2efaea2c-98a9-4180-a1ba-d13b2c3490cf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1281 microversion: 2.20 time: 0.067095 Nov 23 14:38:09.204144 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 516/1025] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:38:09 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:38:10.220565 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d637087d-2e20-453f-8366-2d155166a7b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:10.221244 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d637087d-2e20-453f-8366-2d155166a7b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:10.228393 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d637087d-2e20-453f-8366-2d155166a7b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:10.228839 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d637087d-2e20-453f-8366-2d155166a7b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:10.229687 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d637087d-2e20-453f-8366-2d155166a7b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:10.230119 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d637087d-2e20-453f-8366-2d155166a7b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:10.290561 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d637087d-2e20-453f-8366-2d155166a7b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:10.298441 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d637087d-2e20-453f-8366-2d155166a7b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:10.299983 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d637087d-2e20-453f-8366-2d155166a7b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:10.303208 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d637087d-2e20-453f-8366-2d155166a7b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1277 microversion: 2.20 time: 0.086262 Nov 23 14:38:10.304122 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 510/1026] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:38:10 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:38:11.321962 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1b856ae5-c1d7-46da-a331-ff56623fd04d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:11.322568 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1b856ae5-c1d7-46da-a331-ff56623fd04d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:11.329730 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1b856ae5-c1d7-46da-a331-ff56623fd04d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:11.330176 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1b856ae5-c1d7-46da-a331-ff56623fd04d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:11.330962 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1b856ae5-c1d7-46da-a331-ff56623fd04d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:11.331399 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1b856ae5-c1d7-46da-a331-ff56623fd04d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:11.399844 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1b856ae5-c1d7-46da-a331-ff56623fd04d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:11.407684 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1b856ae5-c1d7-46da-a331-ff56623fd04d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:11.409385 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1b856ae5-c1d7-46da-a331-ff56623fd04d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:11.410500 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1b856ae5-c1d7-46da-a331-ff56623fd04d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1339 microversion: 2.20 time: 0.092502 Nov 23 14:38:11.411061 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 517/1027] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:38:11 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1339 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:38:12.422463 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-1fcd9523-64ae-40e9-ab00-9a91d8edea0e req-30799d7c-9f47-4200-aa79-20ac662c71d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2857aac3-a684-44f3-8205-e73b0f8505ce", "tag": "34eaa672-bc07-44f3-9bb4-56d1e4fcbcbd"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:12.425981 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:38:12.425981 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:38:12.429323 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-fe3e0d8b-c4b8-41d1-a899-de14a69621ac tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:12.429990 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-fe3e0d8b-c4b8-41d1-a899-de14a69621ac tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:12.435455 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-1fcd9523-64ae-40e9-ab00-9a91d8edea0e req-30799d7c-9f47-4200-aa79-20ac662c71d3 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:12.436457 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-1fcd9523-64ae-40e9-ab00-9a91d8edea0e req-30799d7c-9f47-4200-aa79-20ac662c71d3 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:12.438148 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fe3e0d8b-c4b8-41d1-a899-de14a69621ac tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:12.438601 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fe3e0d8b-c4b8-41d1-a899-de14a69621ac tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:12.439692 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fe3e0d8b-c4b8-41d1-a899-de14a69621ac tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:12.440131 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fe3e0d8b-c4b8-41d1-a899-de14a69621ac tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:12.458424 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-1fcd9523-64ae-40e9-ab00-9a91d8edea0e req-30799d7c-9f47-4200-aa79-20ac662c71d3 service nova] Creating event network-changed:34eaa672-bc07-44f3-9bb4-56d1e4fcbcbd for instance 2857aac3-a684-44f3-8205-e73b0f8505ce on hv-cinder-80475 Nov 23 14:38:12.465692 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-1fcd9523-64ae-40e9-ab00-9a91d8edea0e req-30799d7c-9f47-4200-aa79-20ac662c71d3 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046956 Nov 23 14:38:12.466564 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 511/1028] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:38:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:38:12.940581 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-fe3e0d8b-c4b8-41d1-a899-de14a69621ac tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:12.948828 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-fe3e0d8b-c4b8-41d1-a899-de14a69621ac tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:12.950309 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-fe3e0d8b-c4b8-41d1-a899-de14a69621ac tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:12.951414 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-fe3e0d8b-c4b8-41d1-a899-de14a69621ac tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1407 microversion: 2.20 time: 0.526145 Nov 23 14:38:12.951976 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 518/1029] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:38:12 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1407 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:38:13.970960 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f18d6993-767b-4d68-b2d8-9b504ea8ac0e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:13.971654 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f18d6993-767b-4d68-b2d8-9b504ea8ac0e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:13.978461 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f18d6993-767b-4d68-b2d8-9b504ea8ac0e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:13.978914 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f18d6993-767b-4d68-b2d8-9b504ea8ac0e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:13.979689 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f18d6993-767b-4d68-b2d8-9b504ea8ac0e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:13.980125 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f18d6993-767b-4d68-b2d8-9b504ea8ac0e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:14.108453 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f18d6993-767b-4d68-b2d8-9b504ea8ac0e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:14.116087 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f18d6993-767b-4d68-b2d8-9b504ea8ac0e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:14.117836 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f18d6993-767b-4d68-b2d8-9b504ea8ac0e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:14.118936 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f18d6993-767b-4d68-b2d8-9b504ea8ac0e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1407 microversion: 2.20 time: 0.152528 Nov 23 14:38:14.119494 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 512/1030] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:38:13 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:38:14.981599 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c97843cf-9741-4918-9e70-49f32cf71c29 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:14.982313 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c97843cf-9741-4918-9e70-49f32cf71c29 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:14.988101 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c97843cf-9741-4918-9e70-49f32cf71c29 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:14.988582 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c97843cf-9741-4918-9e70-49f32cf71c29 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:14.989352 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c97843cf-9741-4918-9e70-49f32cf71c29 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:14.989780 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c97843cf-9741-4918-9e70-49f32cf71c29 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:15.012975 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.objects.instance [None req-c97843cf-9741-4918-9e70-49f32cf71c29 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lazy-loading 'flavor' on Instance uuid 09d82b41-cf80-4881-975e-eb1d71b0efc7 {{(pid=116788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:38:15.137254 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3b1bcf86-04c3-4967-af46-6621c8cd24c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:15.137881 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3b1bcf86-04c3-4967-af46-6621c8cd24c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:15.144047 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3b1bcf86-04c3-4967-af46-6621c8cd24c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:15.144524 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3b1bcf86-04c3-4967-af46-6621c8cd24c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:15.145290 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3b1bcf86-04c3-4967-af46-6621c8cd24c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:15.145720 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3b1bcf86-04c3-4967-af46-6621c8cd24c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:15.277380 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3b1bcf86-04c3-4967-af46-6621c8cd24c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:15.284354 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c97843cf-9741-4918-9e70-49f32cf71c29 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "POST /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7/action" status: 202 len: 0 microversion: 2.1 time: 0.306159 Nov 23 14:38:15.284953 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 519/1031] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:38:14 2021] POST /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:38:15.285290 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3b1bcf86-04c3-4967-af46-6621c8cd24c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:15.286806 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3b1bcf86-04c3-4967-af46-6621c8cd24c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:15.287926 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3b1bcf86-04c3-4967-af46-6621c8cd24c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1407 microversion: 2.20 time: 0.154408 Nov 23 14:38:15.299354 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 513/1032] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:38:15 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:38:15.299526 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6f2fa7a5-29d8-47a0-ad3c-dad1676135ed tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:15.299526 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6f2fa7a5-29d8-47a0-ad3c-dad1676135ed tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:15.305032 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6f2fa7a5-29d8-47a0-ad3c-dad1676135ed tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:15.305032 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6f2fa7a5-29d8-47a0-ad3c-dad1676135ed tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:15.305032 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6f2fa7a5-29d8-47a0-ad3c-dad1676135ed tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:15.305032 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6f2fa7a5-29d8-47a0-ad3c-dad1676135ed tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:15.441168 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6f2fa7a5-29d8-47a0-ad3c-dad1676135ed tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:15.448658 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6f2fa7a5-29d8-47a0-ad3c-dad1676135ed tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.157949 Nov 23 14:38:15.449227 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 520/1033] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:15 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:16.306430 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-79bb0ded-6463-45d2-a226-d867dc4fe137 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:16.307034 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-79bb0ded-6463-45d2-a226-d867dc4fe137 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:16.313175 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-79bb0ded-6463-45d2-a226-d867dc4fe137 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:16.313628 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-79bb0ded-6463-45d2-a226-d867dc4fe137 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:16.314404 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-79bb0ded-6463-45d2-a226-d867dc4fe137 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:16.314834 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-79bb0ded-6463-45d2-a226-d867dc4fe137 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:16.444042 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-79bb0ded-6463-45d2-a226-d867dc4fe137 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:16.452543 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-79bb0ded-6463-45d2-a226-d867dc4fe137 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:16.454032 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-79bb0ded-6463-45d2-a226-d867dc4fe137 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:16.455159 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-79bb0ded-6463-45d2-a226-d867dc4fe137 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1407 microversion: 2.20 time: 0.152728 Nov 23 14:38:16.455751 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 514/1034] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:38:16 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:38:16.465758 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ce468bb9-227f-42be-9224-92c7dc923d46 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:16.466408 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ce468bb9-227f-42be-9224-92c7dc923d46 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:16.472610 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ce468bb9-227f-42be-9224-92c7dc923d46 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:16.475873 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ce468bb9-227f-42be-9224-92c7dc923d46 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:16.475873 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ce468bb9-227f-42be-9224-92c7dc923d46 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:16.475873 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ce468bb9-227f-42be-9224-92c7dc923d46 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:16.606890 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ce468bb9-227f-42be-9224-92c7dc923d46 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:16.614180 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ce468bb9-227f-42be-9224-92c7dc923d46 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.152045 Nov 23 14:38:16.614742 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 521/1035] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:16 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:17.472665 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2e21432f-5cab-40f5-a815-13f1b0ccbff2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:17.473293 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2e21432f-5cab-40f5-a815-13f1b0ccbff2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:17.480339 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2e21432f-5cab-40f5-a815-13f1b0ccbff2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:17.480785 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2e21432f-5cab-40f5-a815-13f1b0ccbff2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:17.481544 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2e21432f-5cab-40f5-a815-13f1b0ccbff2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:17.481971 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2e21432f-5cab-40f5-a815-13f1b0ccbff2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:17.610539 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2e21432f-5cab-40f5-a815-13f1b0ccbff2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:17.619266 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2e21432f-5cab-40f5-a815-13f1b0ccbff2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:17.620825 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2e21432f-5cab-40f5-a815-13f1b0ccbff2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:17.621861 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2e21432f-5cab-40f5-a815-13f1b0ccbff2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1407 microversion: 2.20 time: 0.152828 Nov 23 14:38:17.622415 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 515/1036] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:38:17 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:38:17.630342 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bf1f93ca-0ba9-4363-804b-f39926f95e3e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:17.631291 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bf1f93ca-0ba9-4363-804b-f39926f95e3e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:17.638086 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bf1f93ca-0ba9-4363-804b-f39926f95e3e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:17.638627 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bf1f93ca-0ba9-4363-804b-f39926f95e3e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:17.639410 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bf1f93ca-0ba9-4363-804b-f39926f95e3e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:17.639842 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bf1f93ca-0ba9-4363-804b-f39926f95e3e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:17.773736 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-bf1f93ca-0ba9-4363-804b-f39926f95e3e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:17.781007 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bf1f93ca-0ba9-4363-804b-f39926f95e3e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.154225 Nov 23 14:38:17.783481 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 522/1037] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:17 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:18.612102 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-11a4ee06-a1d9-460f-b047-5b475837652e req-30db914d-e3c2-4ca1-a903-8851685f7ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2857aac3-a684-44f3-8205-e73b0f8505ce", "name": "network-vif-plugged", "status": "completed", "tag": "34eaa672-bc07-44f3-9bb4-56d1e4fcbcbd"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:18.613635 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:38:18.613635 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:38:18.620799 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-11a4ee06-a1d9-460f-b047-5b475837652e req-30db914d-e3c2-4ca1-a903-8851685f7ead service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:18.621238 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-11a4ee06-a1d9-460f-b047-5b475837652e req-30db914d-e3c2-4ca1-a903-8851685f7ead service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:18.631696 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-11a4ee06-a1d9-460f-b047-5b475837652e req-30db914d-e3c2-4ca1-a903-8851685f7ead service nova] Creating event network-vif-plugged:34eaa672-bc07-44f3-9bb4-56d1e4fcbcbd for instance 2857aac3-a684-44f3-8205-e73b0f8505ce on hv-cinder-80475 Nov 23 14:38:18.636479 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-11a4ee06-a1d9-460f-b047-5b475837652e req-30db914d-e3c2-4ca1-a903-8851685f7ead service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028014 Nov 23 14:38:18.637065 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 516/1038] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:38:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:38:18.639919 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-0eef9d7b-d28a-480c-86ba-eb7a20dc6fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:18.640548 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-0eef9d7b-d28a-480c-86ba-eb7a20dc6fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:18.647449 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0eef9d7b-d28a-480c-86ba-eb7a20dc6fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:18.647847 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0eef9d7b-d28a-480c-86ba-eb7a20dc6fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:18.648659 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0eef9d7b-d28a-480c-86ba-eb7a20dc6fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:18.649091 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0eef9d7b-d28a-480c-86ba-eb7a20dc6fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:18.780862 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-0eef9d7b-d28a-480c-86ba-eb7a20dc6fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:18.789279 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-0eef9d7b-d28a-480c-86ba-eb7a20dc6fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:18.790748 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-0eef9d7b-d28a-480c-86ba-eb7a20dc6fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:18.791945 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-0eef9d7b-d28a-480c-86ba-eb7a20dc6fbc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1407 microversion: 2.20 time: 0.155828 Nov 23 14:38:18.792561 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 523/1039] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:38:18 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:38:18.798715 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3fc3a5d9-696b-40bd-b8ee-8247d4b3cae0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:18.799400 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3fc3a5d9-696b-40bd-b8ee-8247d4b3cae0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:18.805493 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3fc3a5d9-696b-40bd-b8ee-8247d4b3cae0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:18.805936 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3fc3a5d9-696b-40bd-b8ee-8247d4b3cae0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:18.806699 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3fc3a5d9-696b-40bd-b8ee-8247d4b3cae0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:18.807124 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3fc3a5d9-696b-40bd-b8ee-8247d4b3cae0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:18.945267 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3fc3a5d9-696b-40bd-b8ee-8247d4b3cae0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:18.952586 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3fc3a5d9-696b-40bd-b8ee-8247d4b3cae0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.157680 Nov 23 14:38:18.953158 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 517/1040] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:18 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:19.810207 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c45a41b9-12a5-4018-9d0d-0370c4632764 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:19.810798 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c45a41b9-12a5-4018-9d0d-0370c4632764 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:19.817124 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c45a41b9-12a5-4018-9d0d-0370c4632764 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:19.817566 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c45a41b9-12a5-4018-9d0d-0370c4632764 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:19.818331 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c45a41b9-12a5-4018-9d0d-0370c4632764 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:19.819324 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c45a41b9-12a5-4018-9d0d-0370c4632764 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:19.948593 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c45a41b9-12a5-4018-9d0d-0370c4632764 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:19.956149 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c45a41b9-12a5-4018-9d0d-0370c4632764 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:19.957663 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c45a41b9-12a5-4018-9d0d-0370c4632764 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:19.958750 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c45a41b9-12a5-4018-9d0d-0370c4632764 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1407 microversion: 2.20 time: 0.152328 Nov 23 14:38:19.959368 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 524/1041] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:38:19 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:38:19.969412 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-95a302d5-54d2-4124-a697-71bbc0aacae2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:19.970015 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-95a302d5-54d2-4124-a697-71bbc0aacae2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:19.976340 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-95a302d5-54d2-4124-a697-71bbc0aacae2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:19.978595 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-95a302d5-54d2-4124-a697-71bbc0aacae2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:19.978595 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-95a302d5-54d2-4124-a697-71bbc0aacae2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:19.978595 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-95a302d5-54d2-4124-a697-71bbc0aacae2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:20.106597 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-95a302d5-54d2-4124-a697-71bbc0aacae2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:20.113765 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-95a302d5-54d2-4124-a697-71bbc0aacae2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.147988 Nov 23 14:38:20.114327 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 518/1042] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:19 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:20.977235 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-99a1600c-ef8f-4e3a-816e-20cf430afe52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:20.977829 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-99a1600c-ef8f-4e3a-816e-20cf430afe52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:20.984073 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-99a1600c-ef8f-4e3a-816e-20cf430afe52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:20.984542 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-99a1600c-ef8f-4e3a-816e-20cf430afe52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:20.985313 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-99a1600c-ef8f-4e3a-816e-20cf430afe52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:20.985738 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-99a1600c-ef8f-4e3a-816e-20cf430afe52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:21.118129 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-99a1600c-ef8f-4e3a-816e-20cf430afe52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:21.125981 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-99a1600c-ef8f-4e3a-816e-20cf430afe52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:21.127443 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-99a1600c-ef8f-4e3a-816e-20cf430afe52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:21.128609 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-99a1600c-ef8f-4e3a-816e-20cf430afe52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1599 microversion: 2.20 time: 0.155670 Nov 23 14:38:21.129361 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 525/1043] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:38:20 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:38:21.130736 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-340499ad-fb0b-4387-90f0-9b0659fd9504 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:21.131867 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-340499ad-fb0b-4387-90f0-9b0659fd9504 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:21.138164 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-340499ad-fb0b-4387-90f0-9b0659fd9504 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:21.138614 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-340499ad-fb0b-4387-90f0-9b0659fd9504 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:21.139389 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-340499ad-fb0b-4387-90f0-9b0659fd9504 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:21.139820 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-340499ad-fb0b-4387-90f0-9b0659fd9504 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:21.147571 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-75cf2714-9590-4590-9a22-00f8c6a10b8c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:21.148049 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-75cf2714-9590-4590-9a22-00f8c6a10b8c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:21.153882 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-75cf2714-9590-4590-9a22-00f8c6a10b8c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:21.154324 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-75cf2714-9590-4590-9a22-00f8c6a10b8c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:21.155087 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-75cf2714-9590-4590-9a22-00f8c6a10b8c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:21.155522 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-75cf2714-9590-4590-9a22-00f8c6a10b8c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:21.237258 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-75cf2714-9590-4590-9a22-00f8c6a10b8c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093781 Nov 23 14:38:21.238049 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 526/1044] 10.222.0.82 () {60 vars in 1315 bytes} [Tue Nov 23 14:38:21 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:38:21.275442 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-340499ad-fb0b-4387-90f0-9b0659fd9504 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:21.286266 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-340499ad-fb0b-4387-90f0-9b0659fd9504 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.158970 Nov 23 14:38:21.287300 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 519/1045] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:21 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:38:22.203476 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-80246991-129a-4013-966b-a16d75b5b30b req-fc90b449-3edb-4f99-95be-45fdd3875ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2857aac3-a684-44f3-8205-e73b0f8505ce", "tag": "34eaa672-bc07-44f3-9bb4-56d1e4fcbcbd"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:22.205680 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:38:22.205680 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:38:22.205870 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b16fe1f4-5b66-4192-bdb3-d2a62c9e8ad1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:22.207418 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b16fe1f4-5b66-4192-bdb3-d2a62c9e8ad1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:22.214020 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b16fe1f4-5b66-4192-bdb3-d2a62c9e8ad1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:22.214470 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b16fe1f4-5b66-4192-bdb3-d2a62c9e8ad1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:22.214588 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-80246991-129a-4013-966b-a16d75b5b30b req-fc90b449-3edb-4f99-95be-45fdd3875ad9 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:22.215100 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-80246991-129a-4013-966b-a16d75b5b30b req-fc90b449-3edb-4f99-95be-45fdd3875ad9 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:22.215245 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b16fe1f4-5b66-4192-bdb3-d2a62c9e8ad1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:22.215678 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b16fe1f4-5b66-4192-bdb3-d2a62c9e8ad1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:22.227162 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-80246991-129a-4013-966b-a16d75b5b30b req-fc90b449-3edb-4f99-95be-45fdd3875ad9 service nova] Creating event network-changed:34eaa672-bc07-44f3-9bb4-56d1e4fcbcbd for instance 2857aac3-a684-44f3-8205-e73b0f8505ce on hv-cinder-80475 Nov 23 14:38:22.233051 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-80246991-129a-4013-966b-a16d75b5b30b req-fc90b449-3edb-4f99-95be-45fdd3875ad9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033661 Nov 23 14:38:22.233992 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 520/1046] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:38:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:38:22.283928 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b16fe1f4-5b66-4192-bdb3-d2a62c9e8ad1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 14 microversion: 2.20 time: 0.086507 Nov 23 14:38:22.284778 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 527/1047] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:22 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:22.305367 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-84f648b1-662f-4cc2-abc7-5b627c6d1540 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:22.306055 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-84f648b1-662f-4cc2-abc7-5b627c6d1540 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:22.312386 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84f648b1-662f-4cc2-abc7-5b627c6d1540 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:22.312772 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84f648b1-662f-4cc2-abc7-5b627c6d1540 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:22.313538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84f648b1-662f-4cc2-abc7-5b627c6d1540 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:22.313971 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84f648b1-662f-4cc2-abc7-5b627c6d1540 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:22.461948 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-84f648b1-662f-4cc2-abc7-5b627c6d1540 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:22.469500 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-84f648b1-662f-4cc2-abc7-5b627c6d1540 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.168401 Nov 23 14:38:22.479911 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 521/1048] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:22 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:23.295223 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-696106c9-2c46-40ce-bdc8-06c00ad1ba00 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:23.296195 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-696106c9-2c46-40ce-bdc8-06c00ad1ba00 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:23.303113 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-696106c9-2c46-40ce-bdc8-06c00ad1ba00 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:23.303706 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-696106c9-2c46-40ce-bdc8-06c00ad1ba00 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:23.304506 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-696106c9-2c46-40ce-bdc8-06c00ad1ba00 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:23.304938 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-696106c9-2c46-40ce-bdc8-06c00ad1ba00 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:23.366082 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-696106c9-2c46-40ce-bdc8-06c00ad1ba00 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 14 microversion: 2.20 time: 0.074677 Nov 23 14:38:23.369451 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 528/1049] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:23 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:23.486756 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-600d8c2f-6167-4234-b0fc-95684e3d3bab tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:23.487359 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-600d8c2f-6167-4234-b0fc-95684e3d3bab tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:23.493803 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-600d8c2f-6167-4234-b0fc-95684e3d3bab tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:23.494250 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-600d8c2f-6167-4234-b0fc-95684e3d3bab tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:23.495019 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-600d8c2f-6167-4234-b0fc-95684e3d3bab tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:23.495449 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-600d8c2f-6167-4234-b0fc-95684e3d3bab tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:23.623359 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-600d8c2f-6167-4234-b0fc-95684e3d3bab tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:23.631311 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-600d8c2f-6167-4234-b0fc-95684e3d3bab tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.147716 Nov 23 14:38:23.631883 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 522/1050] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:23 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:24.377554 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e6d35f48-72e5-4ffa-b606-dbcee2364bd9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:24.378537 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e6d35f48-72e5-4ffa-b606-dbcee2364bd9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:24.386109 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e6d35f48-72e5-4ffa-b606-dbcee2364bd9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:24.386550 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e6d35f48-72e5-4ffa-b606-dbcee2364bd9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:24.387319 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e6d35f48-72e5-4ffa-b606-dbcee2364bd9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:24.387752 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e6d35f48-72e5-4ffa-b606-dbcee2364bd9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:24.460949 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e6d35f48-72e5-4ffa-b606-dbcee2364bd9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 14 microversion: 2.20 time: 0.087286 Nov 23 14:38:24.461729 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 529/1051] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:24 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:24.648033 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9121b967-a0d8-4b60-acc6-542bb647227a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:24.648670 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9121b967-a0d8-4b60-acc6-542bb647227a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:24.654853 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9121b967-a0d8-4b60-acc6-542bb647227a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:24.655313 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9121b967-a0d8-4b60-acc6-542bb647227a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:24.656082 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9121b967-a0d8-4b60-acc6-542bb647227a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:24.656555 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9121b967-a0d8-4b60-acc6-542bb647227a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:24.788620 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9121b967-a0d8-4b60-acc6-542bb647227a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:24.795710 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9121b967-a0d8-4b60-acc6-542bb647227a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.151397 Nov 23 14:38:24.796289 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 523/1052] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:24 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:25.472318 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9610a8de-9152-473b-8f30-20ce19fd8bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:25.473313 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9610a8de-9152-473b-8f30-20ce19fd8bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:25.481336 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9610a8de-9152-473b-8f30-20ce19fd8bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:25.481784 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9610a8de-9152-473b-8f30-20ce19fd8bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:25.482555 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9610a8de-9152-473b-8f30-20ce19fd8bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:25.482991 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9610a8de-9152-473b-8f30-20ce19fd8bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:25.553469 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9610a8de-9152-473b-8f30-20ce19fd8bf9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 14 microversion: 2.20 time: 0.084759 Nov 23 14:38:25.554080 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 530/1053] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:25 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:25.813346 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-980ac846-302b-43bd-bbcd-50c15bedf0f4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:25.813985 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-980ac846-302b-43bd-bbcd-50c15bedf0f4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:25.820854 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-980ac846-302b-43bd-bbcd-50c15bedf0f4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:25.821303 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-980ac846-302b-43bd-bbcd-50c15bedf0f4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:25.822076 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-980ac846-302b-43bd-bbcd-50c15bedf0f4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:25.822508 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-980ac846-302b-43bd-bbcd-50c15bedf0f4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:25.951946 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-980ac846-302b-43bd-bbcd-50c15bedf0f4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:25.959851 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-980ac846-302b-43bd-bbcd-50c15bedf0f4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.149527 Nov 23 14:38:25.960326 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 524/1054] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:25 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:26.564805 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c82141a2-091d-492e-b4ca-d21807ee21f4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:26.565792 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c82141a2-091d-492e-b4ca-d21807ee21f4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:26.572619 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c82141a2-091d-492e-b4ca-d21807ee21f4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:26.573348 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c82141a2-091d-492e-b4ca-d21807ee21f4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:26.573826 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c82141a2-091d-492e-b4ca-d21807ee21f4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:26.574263 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c82141a2-091d-492e-b4ca-d21807ee21f4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:26.637622 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c82141a2-091d-492e-b4ca-d21807ee21f4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 14 microversion: 2.20 time: 0.076774 Nov 23 14:38:26.638179 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 531/1055] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:26 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:26.976614 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a4121ef7-53a9-4c85-82c2-e0e0e495a0dc tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:26.977021 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a4121ef7-53a9-4c85-82c2-e0e0e495a0dc tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:26.983390 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a4121ef7-53a9-4c85-82c2-e0e0e495a0dc tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:26.983847 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a4121ef7-53a9-4c85-82c2-e0e0e495a0dc tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:26.984663 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a4121ef7-53a9-4c85-82c2-e0e0e495a0dc tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:26.985903 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a4121ef7-53a9-4c85-82c2-e0e0e495a0dc tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:27.119033 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a4121ef7-53a9-4c85-82c2-e0e0e495a0dc tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:27.126170 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a4121ef7-53a9-4c85-82c2-e0e0e495a0dc tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.154236 Nov 23 14:38:27.126739 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 525/1056] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:26 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:27.648858 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9eb2461b-4133-4b5a-aa3b-2a462a554efe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:27.649756 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9eb2461b-4133-4b5a-aa3b-2a462a554efe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:27.656540 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9eb2461b-4133-4b5a-aa3b-2a462a554efe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:27.656983 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9eb2461b-4133-4b5a-aa3b-2a462a554efe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:27.657742 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9eb2461b-4133-4b5a-aa3b-2a462a554efe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:27.658168 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9eb2461b-4133-4b5a-aa3b-2a462a554efe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:27.715783 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9eb2461b-4133-4b5a-aa3b-2a462a554efe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 14 microversion: 2.20 time: 0.071613 Nov 23 14:38:27.716439 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 532/1057] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:27 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:28.143714 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2b5bafc7-5a6a-4fc4-ac57-33f0c51ac72b tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:28.144348 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2b5bafc7-5a6a-4fc4-ac57-33f0c51ac72b tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:28.151155 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2b5bafc7-5a6a-4fc4-ac57-33f0c51ac72b tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:28.151598 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2b5bafc7-5a6a-4fc4-ac57-33f0c51ac72b tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:28.152383 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2b5bafc7-5a6a-4fc4-ac57-33f0c51ac72b tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:28.152812 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2b5bafc7-5a6a-4fc4-ac57-33f0c51ac72b tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:28.283485 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2b5bafc7-5a6a-4fc4-ac57-33f0c51ac72b tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:28.291052 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2b5bafc7-5a6a-4fc4-ac57-33f0c51ac72b tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.150936 Nov 23 14:38:28.291608 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 526/1058] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:28 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:28.728739 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a7129071-618b-442d-a358-a8d4fce1b2ea tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:28.729734 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a7129071-618b-442d-a358-a8d4fce1b2ea tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:28.736555 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a7129071-618b-442d-a358-a8d4fce1b2ea tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:28.737005 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a7129071-618b-442d-a358-a8d4fce1b2ea tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:28.737776 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a7129071-618b-442d-a358-a8d4fce1b2ea tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:28.738213 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a7129071-618b-442d-a358-a8d4fce1b2ea tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:28.804461 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a7129071-618b-442d-a358-a8d4fce1b2ea tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 14 microversion: 2.20 time: 0.080662 Nov 23 14:38:28.805300 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 533/1059] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:28 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:29.307721 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0d9144d7-7d1c-4eda-91b2-bfa9a11efee7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:29.308344 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0d9144d7-7d1c-4eda-91b2-bfa9a11efee7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:29.314667 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0d9144d7-7d1c-4eda-91b2-bfa9a11efee7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:29.315119 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0d9144d7-7d1c-4eda-91b2-bfa9a11efee7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:29.315897 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0d9144d7-7d1c-4eda-91b2-bfa9a11efee7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:29.316364 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0d9144d7-7d1c-4eda-91b2-bfa9a11efee7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:29.470316 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0d9144d7-7d1c-4eda-91b2-bfa9a11efee7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:29.477645 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0d9144d7-7d1c-4eda-91b2-bfa9a11efee7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.173692 Nov 23 14:38:29.478216 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 527/1060] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:29 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:29.815386 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1b72e9b6-7705-4106-b23e-7f9d627ee662 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:29.816410 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1b72e9b6-7705-4106-b23e-7f9d627ee662 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:29.824093 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1b72e9b6-7705-4106-b23e-7f9d627ee662 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:29.824569 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1b72e9b6-7705-4106-b23e-7f9d627ee662 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:29.825346 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1b72e9b6-7705-4106-b23e-7f9d627ee662 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:29.825781 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1b72e9b6-7705-4106-b23e-7f9d627ee662 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:29.897744 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1b72e9b6-7705-4106-b23e-7f9d627ee662 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 14 microversion: 2.20 time: 0.086185 Nov 23 14:38:29.900823 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 534/1061] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:29 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:30.497558 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-716257b2-114c-49b6-a6c3-eed2700fa5d4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:30.498092 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-716257b2-114c-49b6-a6c3-eed2700fa5d4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:30.504323 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-716257b2-114c-49b6-a6c3-eed2700fa5d4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:30.505243 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-716257b2-114c-49b6-a6c3-eed2700fa5d4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:30.506034 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-716257b2-114c-49b6-a6c3-eed2700fa5d4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:30.506469 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-716257b2-114c-49b6-a6c3-eed2700fa5d4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:30.638566 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-716257b2-114c-49b6-a6c3-eed2700fa5d4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:30.648435 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-716257b2-114c-49b6-a6c3-eed2700fa5d4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.154484 Nov 23 14:38:30.652002 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 528/1062] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:30 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:30.908923 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bf011833-6bcd-4dc7-8755-2fa2558ab4cc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:30.909965 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bf011833-6bcd-4dc7-8755-2fa2558ab4cc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:30.916780 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bf011833-6bcd-4dc7-8755-2fa2558ab4cc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:30.917220 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bf011833-6bcd-4dc7-8755-2fa2558ab4cc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:30.918105 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bf011833-6bcd-4dc7-8755-2fa2558ab4cc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:30.918540 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bf011833-6bcd-4dc7-8755-2fa2558ab4cc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:30.983484 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bf011833-6bcd-4dc7-8755-2fa2558ab4cc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 14 microversion: 2.20 time: 0.078413 Nov 23 14:38:30.984123 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 535/1063] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:30 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:31.665538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-fae749e4-f710-4bc6-95cb-5217b8e98048 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:31.666074 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-fae749e4-f710-4bc6-95cb-5217b8e98048 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:31.672203 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fae749e4-f710-4bc6-95cb-5217b8e98048 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:31.672683 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fae749e4-f710-4bc6-95cb-5217b8e98048 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:31.673442 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fae749e4-f710-4bc6-95cb-5217b8e98048 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:31.673871 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fae749e4-f710-4bc6-95cb-5217b8e98048 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:31.803204 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-fae749e4-f710-4bc6-95cb-5217b8e98048 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:31.810508 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-fae749e4-f710-4bc6-95cb-5217b8e98048 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.148645 Nov 23 14:38:31.811072 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 529/1064] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:31 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:31.995656 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e897372d-4b3b-4151-9ffa-bc08278984da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:31.996728 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e897372d-4b3b-4151-9ffa-bc08278984da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:32.003518 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e897372d-4b3b-4151-9ffa-bc08278984da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:32.004090 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e897372d-4b3b-4151-9ffa-bc08278984da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:32.006190 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e897372d-4b3b-4151-9ffa-bc08278984da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:32.006650 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e897372d-4b3b-4151-9ffa-bc08278984da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:32.075032 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e897372d-4b3b-4151-9ffa-bc08278984da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 14 microversion: 2.20 time: 0.083258 Nov 23 14:38:32.075644 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 536/1065] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:31 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:38:32.827631 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7a3db3fa-4f19-42be-ad4c-5948e7b94e9d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:32.828307 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7a3db3fa-4f19-42be-ad4c-5948e7b94e9d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:32.835020 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a3db3fa-4f19-42be-ad4c-5948e7b94e9d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:32.835473 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a3db3fa-4f19-42be-ad4c-5948e7b94e9d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:32.836257 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a3db3fa-4f19-42be-ad4c-5948e7b94e9d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:32.836705 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a3db3fa-4f19-42be-ad4c-5948e7b94e9d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:32.974831 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7a3db3fa-4f19-42be-ad4c-5948e7b94e9d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:32.982031 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7a3db3fa-4f19-42be-ad4c-5948e7b94e9d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.157972 Nov 23 14:38:32.987426 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 530/1066] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:32 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:33.086141 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3c28a5b1-c8ba-42e3-931d-348b507019b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:33.087036 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3c28a5b1-c8ba-42e3-931d-348b507019b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:33.093691 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3c28a5b1-c8ba-42e3-931d-348b507019b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:33.094134 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3c28a5b1-c8ba-42e3-931d-348b507019b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:33.094898 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3c28a5b1-c8ba-42e3-931d-348b507019b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:33.095327 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3c28a5b1-c8ba-42e3-931d-348b507019b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:33.155465 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3c28a5b1-c8ba-42e3-931d-348b507019b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 14 microversion: 2.20 time: 0.073939 Nov 23 14:38:33.156285 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 537/1067] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:33 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:33.999423 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-994acbb9-f4b2-48de-8731-c07fe3c7fada tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:34.000045 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-994acbb9-f4b2-48de-8731-c07fe3c7fada tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:34.006651 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-994acbb9-f4b2-48de-8731-c07fe3c7fada tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:34.007141 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-994acbb9-f4b2-48de-8731-c07fe3c7fada tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:34.007916 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-994acbb9-f4b2-48de-8731-c07fe3c7fada tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:34.008381 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-994acbb9-f4b2-48de-8731-c07fe3c7fada tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:34.145043 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-994acbb9-f4b2-48de-8731-c07fe3c7fada tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:34.153137 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-994acbb9-f4b2-48de-8731-c07fe3c7fada tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1570 microversion: 2.1 time: 0.157330 Nov 23 14:38:34.153707 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 531/1068] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:33 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:38:34.167745 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ce474628-0b96-48ea-9523-3dbcf0390751 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:34.173030 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4b04b435-6861-4af4-bf2a-58d8649dd083 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:34.173635 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4b04b435-6861-4af4-bf2a-58d8649dd083 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:34.175100 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ce474628-0b96-48ea-9523-3dbcf0390751 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:34.180691 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4b04b435-6861-4af4-bf2a-58d8649dd083 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:34.181142 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4b04b435-6861-4af4-bf2a-58d8649dd083 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:34.181969 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4b04b435-6861-4af4-bf2a-58d8649dd083 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:34.182527 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4b04b435-6861-4af4-bf2a-58d8649dd083 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:34.191818 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ce474628-0b96-48ea-9523-3dbcf0390751 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:34.192325 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ce474628-0b96-48ea-9523-3dbcf0390751 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:34.193517 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ce474628-0b96-48ea-9523-3dbcf0390751 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:34.193949 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ce474628-0b96-48ea-9523-3dbcf0390751 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:34.269233 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ce474628-0b96-48ea-9523-3dbcf0390751 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 6314 microversion: 2.20 time: 0.105804 Nov 23 14:38:34.270054 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 538/1069] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:34 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 6314 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:38:34.428684 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4b04b435-6861-4af4-bf2a-58d8649dd083 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "POST /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7/action" status: 202 len: 0 microversion: 2.1 time: 0.259245 Nov 23 14:38:34.429586 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 532/1070] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:38:34 2021] POST /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:34.438158 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7789bd30-707f-443e-bde0-93644b28948e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:34.439120 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7789bd30-707f-443e-bde0-93644b28948e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:34.446176 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7789bd30-707f-443e-bde0-93644b28948e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:34.446630 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7789bd30-707f-443e-bde0-93644b28948e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:34.447439 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7789bd30-707f-443e-bde0-93644b28948e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:34.447879 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7789bd30-707f-443e-bde0-93644b28948e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:34.587401 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7789bd30-707f-443e-bde0-93644b28948e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:34.594743 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7789bd30-707f-443e-bde0-93644b28948e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1518 microversion: 2.1 time: 0.160656 Nov 23 14:38:34.595382 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 539/1071] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:34 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:35.281405 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-973e77a4-a2d5-4728-a546-3e253126bf54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:35.282367 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-973e77a4-a2d5-4728-a546-3e253126bf54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:35.288996 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-973e77a4-a2d5-4728-a546-3e253126bf54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:35.289448 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-973e77a4-a2d5-4728-a546-3e253126bf54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:35.295567 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-973e77a4-a2d5-4728-a546-3e253126bf54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:35.295567 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-973e77a4-a2d5-4728-a546-3e253126bf54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:35.364816 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-973e77a4-a2d5-4728-a546-3e253126bf54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 15025 microversion: 2.20 time: 0.086794 Nov 23 14:38:35.365769 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 533/1072] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:35 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 15025 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:35.612561 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e79f6897-288d-467b-ada8-877b546fef34 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:35.613099 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e79f6897-288d-467b-ada8-877b546fef34 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:35.619285 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e79f6897-288d-467b-ada8-877b546fef34 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:35.623895 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e79f6897-288d-467b-ada8-877b546fef34 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:35.623895 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e79f6897-288d-467b-ada8-877b546fef34 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:35.623895 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e79f6897-288d-467b-ada8-877b546fef34 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:35.755568 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e79f6897-288d-467b-ada8-877b546fef34 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:35.763030 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e79f6897-288d-467b-ada8-877b546fef34 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1520 microversion: 2.1 time: 0.154231 Nov 23 14:38:35.763620 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 540/1073] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:35 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:36.377524 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-054679dc-814c-40d7-b890-8938f840c7f5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:36.383911 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-054679dc-814c-40d7-b890-8938f840c7f5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:36.391434 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-054679dc-814c-40d7-b890-8938f840c7f5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:36.391881 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-054679dc-814c-40d7-b890-8938f840c7f5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:36.393989 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-054679dc-814c-40d7-b890-8938f840c7f5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:36.394496 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-054679dc-814c-40d7-b890-8938f840c7f5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:36.473889 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-3a6b71d4-0747-4a35-b03d-0785a1b17b85 req-91ed6221-e00f-46b2-80bd-6d9ef07405dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d82b41-cf80-4881-975e-eb1d71b0efc7", "name": "network-vif-unplugged", "status": "completed", "tag": "20c986d1-94ea-44c7-9233-9b2ae752b164"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:36.476298 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:38:36.476298 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:38:36.484850 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-3a6b71d4-0747-4a35-b03d-0785a1b17b85 req-91ed6221-e00f-46b2-80bd-6d9ef07405dc service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:36.485323 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-3a6b71d4-0747-4a35-b03d-0785a1b17b85 req-91ed6221-e00f-46b2-80bd-6d9ef07405dc service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:36.492108 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-054679dc-814c-40d7-b890-8938f840c7f5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 18356 microversion: 2.20 time: 0.118744 Nov 23 14:38:36.492815 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 534/1074] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:36 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 18356 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:36.499068 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.compute.server_external_events [req-3a6b71d4-0747-4a35-b03d-0785a1b17b85 req-91ed6221-e00f-46b2-80bd-6d9ef07405dc service nova] Unable to find a host for instance 09d82b41-cf80-4881-975e-eb1d71b0efc7. Dropping event network-vif-unplugged {{(pid=116788) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 23 14:38:36.500001 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-3a6b71d4-0747-4a35-b03d-0785a1b17b85 req-91ed6221-e00f-46b2-80bd-6d9ef07405dc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031492 Nov 23 14:38:36.500615 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 541/1075] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:38:36 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 23 14:38:36.781514 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6473f14b-d899-4dba-8f5e-00c49ff07632 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:36.782223 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6473f14b-d899-4dba-8f5e-00c49ff07632 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:36.789825 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6473f14b-d899-4dba-8f5e-00c49ff07632 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:36.790268 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6473f14b-d899-4dba-8f5e-00c49ff07632 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:36.791108 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6473f14b-d899-4dba-8f5e-00c49ff07632 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:36.791533 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6473f14b-d899-4dba-8f5e-00c49ff07632 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:37.078785 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6473f14b-d899-4dba-8f5e-00c49ff07632 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:37.086457 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6473f14b-d899-4dba-8f5e-00c49ff07632 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1576 microversion: 2.1 time: 0.308913 Nov 23 14:38:37.087042 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 535/1076] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:36 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1576 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:37.502989 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-381f8aa9-daeb-425c-b2ab-8c37b99cfa7b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:37.504264 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-381f8aa9-daeb-425c-b2ab-8c37b99cfa7b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:37.511304 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-381f8aa9-daeb-425c-b2ab-8c37b99cfa7b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:37.511751 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-381f8aa9-daeb-425c-b2ab-8c37b99cfa7b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:37.512557 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-381f8aa9-daeb-425c-b2ab-8c37b99cfa7b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:37.512989 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-381f8aa9-daeb-425c-b2ab-8c37b99cfa7b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:37.586415 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-381f8aa9-daeb-425c-b2ab-8c37b99cfa7b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 19342 microversion: 2.20 time: 0.086973 Nov 23 14:38:37.589305 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 542/1077] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:37 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 19342 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:38.103311 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-12a65603-bf2e-4ba8-bce2-877de1c6584a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:38.103912 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-12a65603-bf2e-4ba8-bce2-877de1c6584a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:38.110015 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-12a65603-bf2e-4ba8-bce2-877de1c6584a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:38.110459 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-12a65603-bf2e-4ba8-bce2-877de1c6584a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:38.111219 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-12a65603-bf2e-4ba8-bce2-877de1c6584a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:38.111648 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-12a65603-bf2e-4ba8-bce2-877de1c6584a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:38.241170 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-12a65603-bf2e-4ba8-bce2-877de1c6584a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:38.248427 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-12a65603-bf2e-4ba8-bce2-877de1c6584a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1576 microversion: 2.1 time: 0.148819 Nov 23 14:38:38.248977 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 536/1078] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:38 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:38:38.598406 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3f8a87aa-7dcf-43b5-9627-717c7a59d586 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:38.599408 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3f8a87aa-7dcf-43b5-9627-717c7a59d586 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:38.606125 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3f8a87aa-7dcf-43b5-9627-717c7a59d586 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:38.606567 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3f8a87aa-7dcf-43b5-9627-717c7a59d586 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:38.607328 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3f8a87aa-7dcf-43b5-9627-717c7a59d586 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:38.607771 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3f8a87aa-7dcf-43b5-9627-717c7a59d586 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:38.728619 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3f8a87aa-7dcf-43b5-9627-717c7a59d586 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 21935 microversion: 2.20 time: 0.134199 Nov 23 14:38:38.729250 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 543/1079] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:38 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 21935 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:39.265117 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-df3471f5-8bcf-4c9b-bc41-149614e992af tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:39.280155 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-df3471f5-8bcf-4c9b-bc41-149614e992af tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:39.280155 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-df3471f5-8bcf-4c9b-bc41-149614e992af tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:39.280155 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-df3471f5-8bcf-4c9b-bc41-149614e992af tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:39.280155 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-df3471f5-8bcf-4c9b-bc41-149614e992af tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:39.280567 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-df3471f5-8bcf-4c9b-bc41-149614e992af tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:39.408584 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-df3471f5-8bcf-4c9b-bc41-149614e992af tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:39.416779 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-df3471f5-8bcf-4c9b-bc41-149614e992af tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1576 microversion: 2.1 time: 0.155412 Nov 23 14:38:39.417314 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 537/1080] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:39 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:39.740635 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c8fc6b0d-f152-4f40-b911-815c5a3b519d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:39.741624 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c8fc6b0d-f152-4f40-b911-815c5a3b519d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:39.748490 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c8fc6b0d-f152-4f40-b911-815c5a3b519d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:39.748940 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c8fc6b0d-f152-4f40-b911-815c5a3b519d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:39.749721 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c8fc6b0d-f152-4f40-b911-815c5a3b519d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:39.750159 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c8fc6b0d-f152-4f40-b911-815c5a3b519d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:39.826646 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c8fc6b0d-f152-4f40-b911-815c5a3b519d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 23235 microversion: 2.20 time: 0.090468 Nov 23 14:38:39.827269 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 544/1081] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:39 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 23235 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:40.434295 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-cbe971c5-53f1-400f-9ca8-0f626ab40f37 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:40.434906 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-cbe971c5-53f1-400f-9ca8-0f626ab40f37 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:40.441184 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cbe971c5-53f1-400f-9ca8-0f626ab40f37 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:40.442073 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cbe971c5-53f1-400f-9ca8-0f626ab40f37 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:40.442879 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cbe971c5-53f1-400f-9ca8-0f626ab40f37 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:40.443318 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cbe971c5-53f1-400f-9ca8-0f626ab40f37 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:40.572210 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-cbe971c5-53f1-400f-9ca8-0f626ab40f37 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:40.579410 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-cbe971c5-53f1-400f-9ca8-0f626ab40f37 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1576 microversion: 2.1 time: 0.148809 Nov 23 14:38:40.579967 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 538/1082] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:40 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:40.839352 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3be82e74-088a-4afe-b07f-85dd2a609d3a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:40.840323 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3be82e74-088a-4afe-b07f-85dd2a609d3a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:40.847096 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3be82e74-088a-4afe-b07f-85dd2a609d3a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:40.847536 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3be82e74-088a-4afe-b07f-85dd2a609d3a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:40.848357 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3be82e74-088a-4afe-b07f-85dd2a609d3a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:40.848794 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3be82e74-088a-4afe-b07f-85dd2a609d3a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:40.918015 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3be82e74-088a-4afe-b07f-85dd2a609d3a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 24841 microversion: 2.20 time: 0.082658 Nov 23 14:38:40.918634 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 545/1083] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:40 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 24841 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:41.597048 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a3bb563f-95b2-475a-b272-2972edc986d4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:41.597692 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a3bb563f-95b2-475a-b272-2972edc986d4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:41.604497 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a3bb563f-95b2-475a-b272-2972edc986d4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:41.604943 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a3bb563f-95b2-475a-b272-2972edc986d4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:41.605718 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a3bb563f-95b2-475a-b272-2972edc986d4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:41.606155 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a3bb563f-95b2-475a-b272-2972edc986d4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:41.738749 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a3bb563f-95b2-475a-b272-2972edc986d4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:41.746139 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a3bb563f-95b2-475a-b272-2972edc986d4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1576 microversion: 2.1 time: 0.152748 Nov 23 14:38:41.746696 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 539/1084] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:41 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:41.930009 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-645a5505-4299-4670-a627-220815cd8213 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:41.931015 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-645a5505-4299-4670-a627-220815cd8213 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:41.937843 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-645a5505-4299-4670-a627-220815cd8213 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:41.938287 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-645a5505-4299-4670-a627-220815cd8213 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:41.939048 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-645a5505-4299-4670-a627-220815cd8213 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:41.939476 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-645a5505-4299-4670-a627-220815cd8213 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:42.024384 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-645a5505-4299-4670-a627-220815cd8213 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 26275 microversion: 2.20 time: 0.098799 Nov 23 14:38:42.025028 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 546/1085] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:41 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 26275 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:42.762633 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4170441e-4189-4c1c-a276-ebc71dcfe57c tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:42.763247 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4170441e-4189-4c1c-a276-ebc71dcfe57c tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:42.770285 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4170441e-4189-4c1c-a276-ebc71dcfe57c tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:42.770739 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4170441e-4189-4c1c-a276-ebc71dcfe57c tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:42.771507 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4170441e-4189-4c1c-a276-ebc71dcfe57c tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:42.771936 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4170441e-4189-4c1c-a276-ebc71dcfe57c tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:42.901475 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4170441e-4189-4c1c-a276-ebc71dcfe57c tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:42.908704 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4170441e-4189-4c1c-a276-ebc71dcfe57c tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1576 microversion: 2.1 time: 0.149668 Nov 23 14:38:42.909264 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 540/1086] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:42 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:43.037054 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1bdd18d5-49aa-42b6-9136-1412401f9aaf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:43.037994 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1bdd18d5-49aa-42b6-9136-1412401f9aaf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:43.044772 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1bdd18d5-49aa-42b6-9136-1412401f9aaf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:43.045219 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1bdd18d5-49aa-42b6-9136-1412401f9aaf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:43.045996 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1bdd18d5-49aa-42b6-9136-1412401f9aaf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:43.046430 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1bdd18d5-49aa-42b6-9136-1412401f9aaf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:43.125399 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1bdd18d5-49aa-42b6-9136-1412401f9aaf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 27421 microversion: 2.20 time: 0.092915 Nov 23 14:38:43.126006 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 547/1087] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:43 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 27421 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:43.926568 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6b64f82f-f749-4bca-b4ae-d5f310e0e4d8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:43.927147 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6b64f82f-f749-4bca-b4ae-d5f310e0e4d8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:43.933307 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6b64f82f-f749-4bca-b4ae-d5f310e0e4d8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:43.933751 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6b64f82f-f749-4bca-b4ae-d5f310e0e4d8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:43.934514 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6b64f82f-f749-4bca-b4ae-d5f310e0e4d8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:43.934939 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6b64f82f-f749-4bca-b4ae-d5f310e0e4d8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:44.063714 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6b64f82f-f749-4bca-b4ae-d5f310e0e4d8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:44.073165 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6b64f82f-f749-4bca-b4ae-d5f310e0e4d8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1576 microversion: 2.1 time: 0.150412 Nov 23 14:38:44.073731 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 541/1088] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:43 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:44.137854 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d910bb07-54b1-4938-adf3-6d2e2fbda4fc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:44.138838 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d910bb07-54b1-4938-adf3-6d2e2fbda4fc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:44.145844 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d910bb07-54b1-4938-adf3-6d2e2fbda4fc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:44.146290 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d910bb07-54b1-4938-adf3-6d2e2fbda4fc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:44.147068 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d910bb07-54b1-4938-adf3-6d2e2fbda4fc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:44.147502 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d910bb07-54b1-4938-adf3-6d2e2fbda4fc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:44.242189 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d910bb07-54b1-4938-adf3-6d2e2fbda4fc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 27823 microversion: 2.20 time: 0.108193 Nov 23 14:38:44.242844 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 548/1089] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:44 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 27823 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:45.089952 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-af72d43c-fb30-49c8-af49-898da825a33a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:45.090535 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-af72d43c-fb30-49c8-af49-898da825a33a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:45.096794 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-af72d43c-fb30-49c8-af49-898da825a33a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:45.097771 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-af72d43c-fb30-49c8-af49-898da825a33a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:45.099132 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-af72d43c-fb30-49c8-af49-898da825a33a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:45.099570 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-af72d43c-fb30-49c8-af49-898da825a33a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:45.231701 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-af72d43c-fb30-49c8-af49-898da825a33a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:45.239518 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-af72d43c-fb30-49c8-af49-898da825a33a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1576 microversion: 2.1 time: 0.153221 Nov 23 14:38:45.240075 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 542/1090] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:45 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:45.254419 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-fb21e94a-1670-46a2-9328-c21f79b9f30f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:45.255534 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-fb21e94a-1670-46a2-9328-c21f79b9f30f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:45.262278 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fb21e94a-1670-46a2-9328-c21f79b9f30f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:45.262721 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fb21e94a-1670-46a2-9328-c21f79b9f30f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:45.263482 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fb21e94a-1670-46a2-9328-c21f79b9f30f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:45.263910 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-fb21e94a-1670-46a2-9328-c21f79b9f30f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:45.337446 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-fb21e94a-1670-46a2-9328-c21f79b9f30f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28197 microversion: 2.20 time: 0.087243 Nov 23 14:38:45.338119 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 549/1091] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:45 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:46.257424 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-17609860-cae1-4e76-826e-139376860431 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:46.258031 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-17609860-cae1-4e76-826e-139376860431 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:46.264224 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-17609860-cae1-4e76-826e-139376860431 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:46.264701 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-17609860-cae1-4e76-826e-139376860431 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:46.265476 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-17609860-cae1-4e76-826e-139376860431 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:46.265913 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-17609860-cae1-4e76-826e-139376860431 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:46.350006 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-366da516-22a0-4a33-a7c1-24f1de9aa1bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:46.350999 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-366da516-22a0-4a33-a7c1-24f1de9aa1bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:46.357874 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-366da516-22a0-4a33-a7c1-24f1de9aa1bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:46.358319 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-366da516-22a0-4a33-a7c1-24f1de9aa1bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:46.359099 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-366da516-22a0-4a33-a7c1-24f1de9aa1bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:46.359534 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-366da516-22a0-4a33-a7c1-24f1de9aa1bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:46.398772 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-17609860-cae1-4e76-826e-139376860431 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:46.406053 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-17609860-cae1-4e76-826e-139376860431 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1576 microversion: 2.1 time: 0.153612 Nov 23 14:38:46.406642 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 543/1092] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:46 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:46.421574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-366da516-22a0-4a33-a7c1-24f1de9aa1bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28197 microversion: 2.20 time: 0.075842 Nov 23 14:38:46.422217 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 550/1093] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:46 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:38:47.422654 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-fa74827a-bf54-4b46-b7bd-bc9ef58824fa tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:47.423261 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-fa74827a-bf54-4b46-b7bd-bc9ef58824fa tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:47.429706 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fa74827a-bf54-4b46-b7bd-bc9ef58824fa tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:47.430152 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fa74827a-bf54-4b46-b7bd-bc9ef58824fa tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:47.430915 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fa74827a-bf54-4b46-b7bd-bc9ef58824fa tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:47.431338 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fa74827a-bf54-4b46-b7bd-bc9ef58824fa tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:47.434014 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-69da59fc-98c3-499b-8973-c765c56884dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:47.435024 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-69da59fc-98c3-499b-8973-c765c56884dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:47.441755 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-69da59fc-98c3-499b-8973-c765c56884dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:47.442205 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-69da59fc-98c3-499b-8973-c765c56884dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:47.443000 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-69da59fc-98c3-499b-8973-c765c56884dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:47.443436 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-69da59fc-98c3-499b-8973-c765c56884dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:47.507080 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-69da59fc-98c3-499b-8973-c765c56884dd tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28197 microversion: 2.20 time: 0.076965 Nov 23 14:38:47.507739 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 551/1094] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:47 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:38:47.564192 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-fa74827a-bf54-4b46-b7bd-bc9ef58824fa tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:47.571618 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-fa74827a-bf54-4b46-b7bd-bc9ef58824fa tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1576 microversion: 2.1 time: 0.152601 Nov 23 14:38:47.572528 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 544/1095] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:47 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:48.519143 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-aeb7c387-c726-4ef9-8506-8039bfda2797 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:48.520134 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-aeb7c387-c726-4ef9-8506-8039bfda2797 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:48.526955 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-aeb7c387-c726-4ef9-8506-8039bfda2797 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:48.527400 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-aeb7c387-c726-4ef9-8506-8039bfda2797 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:48.528170 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-aeb7c387-c726-4ef9-8506-8039bfda2797 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:48.528629 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-aeb7c387-c726-4ef9-8506-8039bfda2797 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:48.588485 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1cc975b8-2541-4f9a-99ee-b35cc2dac943 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:48.589113 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1cc975b8-2541-4f9a-99ee-b35cc2dac943 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:48.592495 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-aeb7c387-c726-4ef9-8506-8039bfda2797 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28197 microversion: 2.20 time: 0.077221 Nov 23 14:38:48.593152 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 552/1096] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:48 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:48.595435 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1cc975b8-2541-4f9a-99ee-b35cc2dac943 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:48.595858 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1cc975b8-2541-4f9a-99ee-b35cc2dac943 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:48.596661 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1cc975b8-2541-4f9a-99ee-b35cc2dac943 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:48.597090 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1cc975b8-2541-4f9a-99ee-b35cc2dac943 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:48.731074 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-1cc975b8-2541-4f9a-99ee-b35cc2dac943 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:48.738497 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1cc975b8-2541-4f9a-99ee-b35cc2dac943 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1576 microversion: 2.1 time: 0.153586 Nov 23 14:38:48.739062 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 545/1097] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:48 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:38:49.605537 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-4c5b3ba2-538b-4d71-be26-3b79ed14039d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:49.606518 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-4c5b3ba2-538b-4d71-be26-3b79ed14039d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:49.613295 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4c5b3ba2-538b-4d71-be26-3b79ed14039d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:49.613739 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4c5b3ba2-538b-4d71-be26-3b79ed14039d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:49.614667 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4c5b3ba2-538b-4d71-be26-3b79ed14039d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:49.615107 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4c5b3ba2-538b-4d71-be26-3b79ed14039d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:49.678116 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-4c5b3ba2-538b-4d71-be26-3b79ed14039d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28197 microversion: 2.20 time: 0.076390 Nov 23 14:38:49.678674 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 553/1098] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:49 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:49.755930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4ca8d871-c0ca-4305-8141-b4054d9f8c26 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:49.756551 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4ca8d871-c0ca-4305-8141-b4054d9f8c26 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:49.762745 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4ca8d871-c0ca-4305-8141-b4054d9f8c26 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:49.763184 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4ca8d871-c0ca-4305-8141-b4054d9f8c26 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:49.763943 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4ca8d871-c0ca-4305-8141-b4054d9f8c26 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:49.764415 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4ca8d871-c0ca-4305-8141-b4054d9f8c26 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:49.892866 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4ca8d871-c0ca-4305-8141-b4054d9f8c26 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:49.900570 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4ca8d871-c0ca-4305-8141-b4054d9f8c26 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1576 microversion: 2.1 time: 0.148475 Nov 23 14:38:49.901123 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 546/1099] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:49 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:50.552580 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-83467c5c-f34e-4f35-bbcd-1c4f0d390c32 req-99a1596f-9f02-4078-83f3-ec4e5ab6661a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d82b41-cf80-4881-975e-eb1d71b0efc7", "name": "network-vif-plugged", "status": "completed", "tag": "20c986d1-94ea-44c7-9233-9b2ae752b164"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:50.554045 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:38:50.554045 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:38:50.561825 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-83467c5c-f34e-4f35-bbcd-1c4f0d390c32 req-99a1596f-9f02-4078-83f3-ec4e5ab6661a service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:50.562270 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-83467c5c-f34e-4f35-bbcd-1c4f0d390c32 req-99a1596f-9f02-4078-83f3-ec4e5ab6661a service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:50.573296 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-83467c5c-f34e-4f35-bbcd-1c4f0d390c32 req-99a1596f-9f02-4078-83f3-ec4e5ab6661a service nova] Creating event network-vif-plugged:20c986d1-94ea-44c7-9233-9b2ae752b164 for instance 09d82b41-cf80-4881-975e-eb1d71b0efc7 on hv-cinder-80475 Nov 23 14:38:50.577940 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-83467c5c-f34e-4f35-bbcd-1c4f0d390c32 req-99a1596f-9f02-4078-83f3-ec4e5ab6661a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029420 Nov 23 14:38:50.578515 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 554/1100] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:38:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:38:50.660084 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:38:50.660690 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: Tue Nov 23 14:38:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:38:50.689154 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9dcc50fc-0d52-4bc7-b0ab-ade035950afe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:50.690639 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9dcc50fc-0d52-4bc7-b0ab-ade035950afe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:50.696208 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9dcc50fc-0d52-4bc7-b0ab-ade035950afe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:50.696700 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9dcc50fc-0d52-4bc7-b0ab-ade035950afe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:50.697519 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9dcc50fc-0d52-4bc7-b0ab-ade035950afe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:50.697935 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9dcc50fc-0d52-4bc7-b0ab-ade035950afe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:50.763070 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9dcc50fc-0d52-4bc7-b0ab-ade035950afe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28197 microversion: 2.20 time: 0.077453 Nov 23 14:38:50.764146 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 547/1101] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:50 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:50.918047 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a3643e7d-223c-44d7-93e5-8295b6be99b0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:50.918737 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a3643e7d-223c-44d7-93e5-8295b6be99b0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:50.930433 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a3643e7d-223c-44d7-93e5-8295b6be99b0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:50.930433 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a3643e7d-223c-44d7-93e5-8295b6be99b0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:50.930433 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a3643e7d-223c-44d7-93e5-8295b6be99b0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:50.930433 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a3643e7d-223c-44d7-93e5-8295b6be99b0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:51.060097 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a3643e7d-223c-44d7-93e5-8295b6be99b0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:51.067847 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a3643e7d-223c-44d7-93e5-8295b6be99b0 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1576 microversion: 2.1 time: 0.154014 Nov 23 14:38:51.068494 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 555/1102] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:50 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:51.775839 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d7a0f468-e035-4a2e-a2f1-05b228234f14 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:51.776860 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d7a0f468-e035-4a2e-a2f1-05b228234f14 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:51.783738 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d7a0f468-e035-4a2e-a2f1-05b228234f14 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:51.784187 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d7a0f468-e035-4a2e-a2f1-05b228234f14 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:51.784986 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d7a0f468-e035-4a2e-a2f1-05b228234f14 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:51.785992 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d7a0f468-e035-4a2e-a2f1-05b228234f14 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:51.846913 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d7a0f468-e035-4a2e-a2f1-05b228234f14 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28197 microversion: 2.20 time: 0.075588 Nov 23 14:38:51.847533 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 548/1103] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:51 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:52.085309 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-53907111-2b7f-4a6f-b072-cedfd3ee4b6d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:52.085875 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-53907111-2b7f-4a6f-b072-cedfd3ee4b6d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:52.091987 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-53907111-2b7f-4a6f-b072-cedfd3ee4b6d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:52.092585 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-53907111-2b7f-4a6f-b072-cedfd3ee4b6d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:52.093358 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-53907111-2b7f-4a6f-b072-cedfd3ee4b6d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:52.093785 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-53907111-2b7f-4a6f-b072-cedfd3ee4b6d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:52.224120 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-53907111-2b7f-4a6f-b072-cedfd3ee4b6d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:52.232213 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-53907111-2b7f-4a6f-b072-cedfd3ee4b6d tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1576 microversion: 2.1 time: 0.151103 Nov 23 14:38:52.232797 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 556/1104] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:52 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:52.859658 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-eb3d1c05-6281-4432-8c2e-ce59e7058547 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:52.860778 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-eb3d1c05-6281-4432-8c2e-ce59e7058547 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:52.868079 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-eb3d1c05-6281-4432-8c2e-ce59e7058547 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:52.868548 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-eb3d1c05-6281-4432-8c2e-ce59e7058547 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:52.869319 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-eb3d1c05-6281-4432-8c2e-ce59e7058547 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:52.869751 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-eb3d1c05-6281-4432-8c2e-ce59e7058547 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:52.935538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-eb3d1c05-6281-4432-8c2e-ce59e7058547 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28197 microversion: 2.20 time: 0.079711 Nov 23 14:38:52.936480 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 549/1105] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:52 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:53.345679 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e6a8dc9c-3e23-422c-950d-767c472f6b2e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:38:53.346311 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e6a8dc9c-3e23-422c-950d-767c472f6b2e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:53.352606 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e6a8dc9c-3e23-422c-950d-767c472f6b2e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:53.353050 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e6a8dc9c-3e23-422c-950d-767c472f6b2e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:53.353810 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e6a8dc9c-3e23-422c-950d-767c472f6b2e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:53.354234 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e6a8dc9c-3e23-422c-950d-767c472f6b2e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:53.486917 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e6a8dc9c-3e23-422c-950d-767c472f6b2e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:38:53.494279 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e6a8dc9c-3e23-422c-950d-767c472f6b2e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1563 microversion: 2.1 time: 0.248725 Nov 23 14:38:53.494838 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 557/1106] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:38:53 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:38:53.948161 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-cde22b3e-3b19-4f6b-9c86-bf49051f0285 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:53.949210 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-cde22b3e-3b19-4f6b-9c86-bf49051f0285 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:53.955940 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cde22b3e-3b19-4f6b-9c86-bf49051f0285 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:53.956426 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cde22b3e-3b19-4f6b-9c86-bf49051f0285 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:53.957202 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cde22b3e-3b19-4f6b-9c86-bf49051f0285 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:53.957639 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cde22b3e-3b19-4f6b-9c86-bf49051f0285 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:54.021846 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-cde22b3e-3b19-4f6b-9c86-bf49051f0285 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28197 microversion: 2.20 time: 0.077060 Nov 23 14:38:54.022466 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 550/1107] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:53 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:55.033371 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c008dcfb-46d1-40c8-9dbb-f59f0c24972d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:55.034326 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c008dcfb-46d1-40c8-9dbb-f59f0c24972d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:55.040576 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c008dcfb-46d1-40c8-9dbb-f59f0c24972d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:55.041024 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c008dcfb-46d1-40c8-9dbb-f59f0c24972d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:55.041800 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c008dcfb-46d1-40c8-9dbb-f59f0c24972d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:55.042238 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c008dcfb-46d1-40c8-9dbb-f59f0c24972d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:55.101962 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c008dcfb-46d1-40c8-9dbb-f59f0c24972d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28197 microversion: 2.20 time: 0.072226 Nov 23 14:38:55.102573 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 558/1108] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:55 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:56.114409 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e6afbf3c-c3f7-46a5-b65b-acccae65f492 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:56.115490 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e6afbf3c-c3f7-46a5-b65b-acccae65f492 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:56.122228 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e6afbf3c-c3f7-46a5-b65b-acccae65f492 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:56.122667 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e6afbf3c-c3f7-46a5-b65b-acccae65f492 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:56.123429 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e6afbf3c-c3f7-46a5-b65b-acccae65f492 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:56.123856 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e6afbf3c-c3f7-46a5-b65b-acccae65f492 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:56.186611 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e6afbf3c-c3f7-46a5-b65b-acccae65f492 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28197 microversion: 2.20 time: 0.076268 Nov 23 14:38:56.187234 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 551/1109] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:56 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:57.198400 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5c53f5a7-32b5-4afa-9bc5-aec0be6ddbf2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:57.199381 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5c53f5a7-32b5-4afa-9bc5-aec0be6ddbf2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:57.206202 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5c53f5a7-32b5-4afa-9bc5-aec0be6ddbf2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:57.206644 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5c53f5a7-32b5-4afa-9bc5-aec0be6ddbf2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:57.207410 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5c53f5a7-32b5-4afa-9bc5-aec0be6ddbf2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:57.207987 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5c53f5a7-32b5-4afa-9bc5-aec0be6ddbf2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:57.294067 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5c53f5a7-32b5-4afa-9bc5-aec0be6ddbf2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28197 microversion: 2.20 time: 0.099417 Nov 23 14:38:57.294621 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 559/1110] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:57 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:58.306333 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-bef6b3d4-01da-4e0c-ba8f-aad29b00516a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:58.307322 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-bef6b3d4-01da-4e0c-ba8f-aad29b00516a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:58.314337 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bef6b3d4-01da-4e0c-ba8f-aad29b00516a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:58.314790 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bef6b3d4-01da-4e0c-ba8f-aad29b00516a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:58.315568 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bef6b3d4-01da-4e0c-ba8f-aad29b00516a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:58.316002 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bef6b3d4-01da-4e0c-ba8f-aad29b00516a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:58.390691 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-bef6b3d4-01da-4e0c-ba8f-aad29b00516a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28197 microversion: 2.20 time: 0.088356 Nov 23 14:38:58.391337 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 552/1111] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:58 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:38:59.402711 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1b4c833d-5c90-436a-9894-17e5a03a5c17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:38:59.403751 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1b4c833d-5c90-436a-9894-17e5a03a5c17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:38:59.410534 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1b4c833d-5c90-436a-9894-17e5a03a5c17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:59.411043 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1b4c833d-5c90-436a-9894-17e5a03a5c17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:59.412464 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1b4c833d-5c90-436a-9894-17e5a03a5c17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:38:59.412927 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1b4c833d-5c90-436a-9894-17e5a03a5c17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:38:59.476300 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1b4c833d-5c90-436a-9894-17e5a03a5c17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28197 microversion: 2.20 time: 0.077559 Nov 23 14:38:59.476906 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 560/1112] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:38:59 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:00.487570 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ba974b18-2182-4161-a3a1-3c3c55d4dc2e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:00.488522 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ba974b18-2182-4161-a3a1-3c3c55d4dc2e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:00.496404 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ba974b18-2182-4161-a3a1-3c3c55d4dc2e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:00.496860 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ba974b18-2182-4161-a3a1-3c3c55d4dc2e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:00.497633 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ba974b18-2182-4161-a3a1-3c3c55d4dc2e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:00.498071 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ba974b18-2182-4161-a3a1-3c3c55d4dc2e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:00.591733 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ba974b18-2182-4161-a3a1-3c3c55d4dc2e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28277 microversion: 2.20 time: 0.108171 Nov 23 14:39:00.592378 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 553/1113] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:00 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:01.603608 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-4b0f9b75-1f8d-43f8-8f3a-9d787b51e41f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:01.605234 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-4b0f9b75-1f8d-43f8-8f3a-9d787b51e41f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:01.612076 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4b0f9b75-1f8d-43f8-8f3a-9d787b51e41f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:01.612540 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4b0f9b75-1f8d-43f8-8f3a-9d787b51e41f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:01.613303 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4b0f9b75-1f8d-43f8-8f3a-9d787b51e41f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:01.614064 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4b0f9b75-1f8d-43f8-8f3a-9d787b51e41f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:01.686696 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-4b0f9b75-1f8d-43f8-8f3a-9d787b51e41f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28488 microversion: 2.20 time: 0.086903 Nov 23 14:39:01.687195 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 561/1114] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:01 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28488 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:02.699051 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-45da58ba-8bf0-403d-ab73-bda30fa7cd52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:02.700053 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-45da58ba-8bf0-403d-ab73-bda30fa7cd52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:02.706832 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45da58ba-8bf0-403d-ab73-bda30fa7cd52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:02.707515 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45da58ba-8bf0-403d-ab73-bda30fa7cd52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:02.708293 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45da58ba-8bf0-403d-ab73-bda30fa7cd52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:02.708728 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45da58ba-8bf0-403d-ab73-bda30fa7cd52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:02.791180 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-45da58ba-8bf0-403d-ab73-bda30fa7cd52 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28629 microversion: 2.20 time: 0.096054 Nov 23 14:39:02.791823 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 554/1115] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:02 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28629 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:03.802908 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-8b3abcf3-fa00-4a1e-847c-54f74a149664 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:03.803927 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-8b3abcf3-fa00-4a1e-847c-54f74a149664 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:03.810797 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8b3abcf3-fa00-4a1e-847c-54f74a149664 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:03.811183 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8b3abcf3-fa00-4a1e-847c-54f74a149664 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:03.811952 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8b3abcf3-fa00-4a1e-847c-54f74a149664 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:03.812421 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8b3abcf3-fa00-4a1e-847c-54f74a149664 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:03.902689 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-8b3abcf3-fa00-4a1e-847c-54f74a149664 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.103738 Nov 23 14:39:03.903317 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 562/1116] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:03 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:39:04.545847 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-78d83284-485e-4f8b-b135-7f3592a5291e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:04.546784 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-78d83284-485e-4f8b-b135-7f3592a5291e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:04.553697 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-78d83284-485e-4f8b-b135-7f3592a5291e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:04.554185 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-78d83284-485e-4f8b-b135-7f3592a5291e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:04.554961 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-78d83284-485e-4f8b-b135-7f3592a5291e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:04.555389 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-78d83284-485e-4f8b-b135-7f3592a5291e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:04.776524 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-78d83284-485e-4f8b-b135-7f3592a5291e tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "POST /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/action" status: 202 len: 0 microversion: 2.1 time: 0.234597 Nov 23 14:39:04.777298 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 555/1117] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:04 2021] POST /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:04.791079 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-372335ce-aba4-4d91-a6ea-739620b09995 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:04.791781 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-372335ce-aba4-4d91-a6ea-739620b09995 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:04.798729 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-372335ce-aba4-4d91-a6ea-739620b09995 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:04.799190 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-372335ce-aba4-4d91-a6ea-739620b09995 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:04.799973 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-372335ce-aba4-4d91-a6ea-739620b09995 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:04.800446 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-372335ce-aba4-4d91-a6ea-739620b09995 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:04.915360 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-faccbf4d-8978-4f68-828c-4e61e8c54af2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:04.916381 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-faccbf4d-8978-4f68-828c-4e61e8c54af2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:04.922463 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-faccbf4d-8978-4f68-828c-4e61e8c54af2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:04.922907 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-faccbf4d-8978-4f68-828c-4e61e8c54af2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:04.923689 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-faccbf4d-8978-4f68-828c-4e61e8c54af2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:04.924127 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-faccbf4d-8978-4f68-828c-4e61e8c54af2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:04.982398 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-372335ce-aba4-4d91-a6ea-739620b09995 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:04.991255 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-372335ce-aba4-4d91-a6ea-739620b09995 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1751 microversion: 2.1 time: 0.204252 Nov 23 14:39:04.991818 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 563/1118] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:04 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1751 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:05.001427 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-faccbf4d-8978-4f68-828c-4e61e8c54af2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.090504 Nov 23 14:39:05.005688 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 556/1119] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:04 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:39:06.009746 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-0b5310c1-e527-4d15-8c93-bf3234692363 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:06.010353 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-0b5310c1-e527-4d15-8c93-bf3234692363 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:06.013383 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-70686a1d-58e1-4da5-a04d-a9d4ea2c4f7c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:06.014376 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-70686a1d-58e1-4da5-a04d-a9d4ea2c4f7c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:06.016786 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0b5310c1-e527-4d15-8c93-bf3234692363 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:06.017239 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0b5310c1-e527-4d15-8c93-bf3234692363 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:06.018021 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0b5310c1-e527-4d15-8c93-bf3234692363 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:06.018450 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0b5310c1-e527-4d15-8c93-bf3234692363 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:06.021149 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-70686a1d-58e1-4da5-a04d-a9d4ea2c4f7c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:06.021598 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-70686a1d-58e1-4da5-a04d-a9d4ea2c4f7c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:06.022381 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-70686a1d-58e1-4da5-a04d-a9d4ea2c4f7c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:06.022814 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-70686a1d-58e1-4da5-a04d-a9d4ea2c4f7c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:06.104376 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-70686a1d-58e1-4da5-a04d-a9d4ea2c4f7c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.094809 Nov 23 14:39:06.105179 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 557/1120] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:06 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:39:06.166280 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-0b5310c1-e527-4d15-8c93-bf3234692363 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:06.173904 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-0b5310c1-e527-4d15-8c93-bf3234692363 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1756 microversion: 2.1 time: 0.167849 Nov 23 14:39:06.174457 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 564/1121] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:06 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:07.117749 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a3ef8701-5b2e-4f51-b18f-e7a69bdab7c8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:07.118907 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a3ef8701-5b2e-4f51-b18f-e7a69bdab7c8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:07.126682 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a3ef8701-5b2e-4f51-b18f-e7a69bdab7c8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:07.127131 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a3ef8701-5b2e-4f51-b18f-e7a69bdab7c8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:07.127916 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a3ef8701-5b2e-4f51-b18f-e7a69bdab7c8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:07.128377 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a3ef8701-5b2e-4f51-b18f-e7a69bdab7c8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:07.191863 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5aa0dc55-95d8-498b-9fb7-3e3fe17d8633 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:07.192587 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5aa0dc55-95d8-498b-9fb7-3e3fe17d8633 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:07.192821 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a3ef8701-5b2e-4f51-b18f-e7a69bdab7c8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.080096 Nov 23 14:39:07.193711 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 558/1122] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:07 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:07.198886 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5aa0dc55-95d8-498b-9fb7-3e3fe17d8633 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:07.199332 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5aa0dc55-95d8-498b-9fb7-3e3fe17d8633 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:07.200105 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5aa0dc55-95d8-498b-9fb7-3e3fe17d8633 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:07.200565 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5aa0dc55-95d8-498b-9fb7-3e3fe17d8633 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:07.346863 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5aa0dc55-95d8-498b-9fb7-3e3fe17d8633 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:07.354926 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5aa0dc55-95d8-498b-9fb7-3e3fe17d8633 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1756 microversion: 2.1 time: 0.167989 Nov 23 14:39:07.355496 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 565/1123] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:07 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:39:08.204885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1dd120fd-9c7e-4b17-b63a-6d28fff3237c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:08.205863 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1dd120fd-9c7e-4b17-b63a-6d28fff3237c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:08.212724 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1dd120fd-9c7e-4b17-b63a-6d28fff3237c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:08.213165 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1dd120fd-9c7e-4b17-b63a-6d28fff3237c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:08.213932 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1dd120fd-9c7e-4b17-b63a-6d28fff3237c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:08.214365 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1dd120fd-9c7e-4b17-b63a-6d28fff3237c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:08.282354 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1dd120fd-9c7e-4b17-b63a-6d28fff3237c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.081326 Nov 23 14:39:08.282994 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 559/1124] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:08 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:08.371885 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d355fa06-cf00-4d7f-9651-9ab5efb4eea1 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:08.372513 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d355fa06-cf00-4d7f-9651-9ab5efb4eea1 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:08.379353 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d355fa06-cf00-4d7f-9651-9ab5efb4eea1 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:08.379791 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d355fa06-cf00-4d7f-9651-9ab5efb4eea1 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:08.380849 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d355fa06-cf00-4d7f-9651-9ab5efb4eea1 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:08.381283 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d355fa06-cf00-4d7f-9651-9ab5efb4eea1 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:08.669179 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d355fa06-cf00-4d7f-9651-9ab5efb4eea1 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:08.677401 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d355fa06-cf00-4d7f-9651-9ab5efb4eea1 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1756 microversion: 2.1 time: 0.309150 Nov 23 14:39:08.677960 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 566/1125] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:08 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1756 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:09.294374 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-733ed1c9-66ea-499c-9df2-7bfbd0c73ead tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:09.295281 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-733ed1c9-66ea-499c-9df2-7bfbd0c73ead tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:09.302234 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-733ed1c9-66ea-499c-9df2-7bfbd0c73ead tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:09.302679 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-733ed1c9-66ea-499c-9df2-7bfbd0c73ead tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:09.303464 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-733ed1c9-66ea-499c-9df2-7bfbd0c73ead tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:09.303903 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-733ed1c9-66ea-499c-9df2-7bfbd0c73ead tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:09.373873 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-733ed1c9-66ea-499c-9df2-7bfbd0c73ead tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.083523 Nov 23 14:39:09.374546 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 560/1126] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:09 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:09.694981 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bbbcf58f-4d15-43f8-9f45-a8493e44a168 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:09.695585 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bbbcf58f-4d15-43f8-9f45-a8493e44a168 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:09.701789 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bbbcf58f-4d15-43f8-9f45-a8493e44a168 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:09.702232 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bbbcf58f-4d15-43f8-9f45-a8493e44a168 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:09.702997 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bbbcf58f-4d15-43f8-9f45-a8493e44a168 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:09.703427 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bbbcf58f-4d15-43f8-9f45-a8493e44a168 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:09.844707 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-bbbcf58f-4d15-43f8-9f45-a8493e44a168 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:09.852371 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bbbcf58f-4d15-43f8-9f45-a8493e44a168 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1756 microversion: 2.1 time: 0.161737 Nov 23 14:39:09.852921 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 567/1127] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:09 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:10.386288 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-32df6e77-94f1-4835-a1e5-7535740df199 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:10.387280 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-32df6e77-94f1-4835-a1e5-7535740df199 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:10.394155 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-32df6e77-94f1-4835-a1e5-7535740df199 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:10.394599 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-32df6e77-94f1-4835-a1e5-7535740df199 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:10.395380 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-32df6e77-94f1-4835-a1e5-7535740df199 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:10.395823 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-32df6e77-94f1-4835-a1e5-7535740df199 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:10.463240 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-32df6e77-94f1-4835-a1e5-7535740df199 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.080846 Nov 23 14:39:10.463937 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 561/1128] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:10 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:10.869412 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-31c60bcc-a6b6-4290-a32f-044f69b5df3d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:10.870010 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-31c60bcc-a6b6-4290-a32f-044f69b5df3d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:10.876582 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-31c60bcc-a6b6-4290-a32f-044f69b5df3d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:10.877022 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-31c60bcc-a6b6-4290-a32f-044f69b5df3d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:10.877783 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-31c60bcc-a6b6-4290-a32f-044f69b5df3d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:10.878308 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-31c60bcc-a6b6-4290-a32f-044f69b5df3d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:11.018834 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-31c60bcc-a6b6-4290-a32f-044f69b5df3d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:11.026616 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-31c60bcc-a6b6-4290-a32f-044f69b5df3d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1756 microversion: 2.1 time: 0.160811 Nov 23 14:39:11.027198 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 568/1129] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:10 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:11.476633 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-966b3316-ecd2-434b-aeb8-b98cea496ad3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:11.477652 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-966b3316-ecd2-434b-aeb8-b98cea496ad3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:11.484408 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-966b3316-ecd2-434b-aeb8-b98cea496ad3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:11.484860 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-966b3316-ecd2-434b-aeb8-b98cea496ad3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:11.485635 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-966b3316-ecd2-434b-aeb8-b98cea496ad3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:11.486074 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-966b3316-ecd2-434b-aeb8-b98cea496ad3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:11.554421 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-966b3316-ecd2-434b-aeb8-b98cea496ad3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.082837 Nov 23 14:39:11.555049 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 562/1130] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:11 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:12.043961 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-087995ef-54d6-49d7-9819-3bd9b789d6eb tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:12.044583 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-087995ef-54d6-49d7-9819-3bd9b789d6eb tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:12.051096 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-087995ef-54d6-49d7-9819-3bd9b789d6eb tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:12.051546 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-087995ef-54d6-49d7-9819-3bd9b789d6eb tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:12.052394 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-087995ef-54d6-49d7-9819-3bd9b789d6eb tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:12.052831 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-087995ef-54d6-49d7-9819-3bd9b789d6eb tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:12.196754 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-087995ef-54d6-49d7-9819-3bd9b789d6eb tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:12.204468 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-087995ef-54d6-49d7-9819-3bd9b789d6eb tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1756 microversion: 2.1 time: 0.164111 Nov 23 14:39:12.205014 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 569/1131] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:12 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:12.566293 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b756ad39-7ed4-43cc-b8a3-891edf34e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:12.567292 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b756ad39-7ed4-43cc-b8a3-891edf34e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:12.574105 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b756ad39-7ed4-43cc-b8a3-891edf34e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:12.574578 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b756ad39-7ed4-43cc-b8a3-891edf34e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:12.575329 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b756ad39-7ed4-43cc-b8a3-891edf34e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:12.575767 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b756ad39-7ed4-43cc-b8a3-891edf34e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:12.652265 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b756ad39-7ed4-43cc-b8a3-891edf34e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.090029 Nov 23 14:39:12.652823 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 563/1132] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:12 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:12.854030 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-06764d90-7b81-4b30-b9ac-ae55092b2c05 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:12.854991 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-06764d90-7b81-4b30-b9ac-ae55092b2c05 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:12.860847 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-06764d90-7b81-4b30-b9ac-ae55092b2c05 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:12.862264 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-06764d90-7b81-4b30-b9ac-ae55092b2c05 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:12.863502 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-06764d90-7b81-4b30-b9ac-ae55092b2c05 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:12.863943 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-06764d90-7b81-4b30-b9ac-ae55092b2c05 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:12.891962 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-06764d90-7b81-4b30-b9ac-ae55092b2c05 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041641 Nov 23 14:39:12.892657 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 570/1133] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:39:12 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:39:12.948106 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7559cb5d-fada-4be6-9f95-723351f96b5a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:12.948704 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7559cb5d-fada-4be6-9f95-723351f96b5a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:12.955502 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7559cb5d-fada-4be6-9f95-723351f96b5a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:12.955974 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7559cb5d-fada-4be6-9f95-723351f96b5a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:12.957334 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7559cb5d-fada-4be6-9f95-723351f96b5a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:12.957766 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7559cb5d-fada-4be6-9f95-723351f96b5a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:12.982316 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7559cb5d-fada-4be6-9f95-723351f96b5a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Going to try to terminate instance {{(pid=116787) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:39:13.222321 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a42dc9c3-06cf-4a70-8923-948d109cd697 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:13.222955 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a42dc9c3-06cf-4a70-8923-948d109cd697 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:13.228982 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a42dc9c3-06cf-4a70-8923-948d109cd697 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:13.229435 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a42dc9c3-06cf-4a70-8923-948d109cd697 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:13.230306 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a42dc9c3-06cf-4a70-8923-948d109cd697 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:13.230671 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a42dc9c3-06cf-4a70-8923-948d109cd697 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:13.321548 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7559cb5d-fada-4be6-9f95-723351f96b5a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "DELETE /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 204 len: 0 microversion: 2.1 time: 0.377044 Nov 23 14:39:13.322140 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 564/1134] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:39:12 2021] DELETE /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 14:39:13.330383 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-654198c8-3b2d-4c72-ba47-5ad1fa94e835 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:13.332294 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-654198c8-3b2d-4c72-ba47-5ad1fa94e835 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:13.338660 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-654198c8-3b2d-4c72-ba47-5ad1fa94e835 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:13.339102 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-654198c8-3b2d-4c72-ba47-5ad1fa94e835 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:13.339880 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-654198c8-3b2d-4c72-ba47-5ad1fa94e835 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:13.340331 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-654198c8-3b2d-4c72-ba47-5ad1fa94e835 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:13.390290 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a42dc9c3-06cf-4a70-8923-948d109cd697 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:13.399202 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a42dc9c3-06cf-4a70-8923-948d109cd697 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1756 microversion: 2.1 time: 0.180612 Nov 23 14:39:13.399695 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 571/1135] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:13 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:39:13.474881 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-654198c8-3b2d-4c72-ba47-5ad1fa94e835 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:13.482122 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-654198c8-3b2d-4c72-ba47-5ad1fa94e835 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1674 microversion: 2.1 time: 0.155621 Nov 23 14:39:13.482687 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 565/1136] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:13 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:39:13.663677 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-2a7a8f73-68dd-471e-9581-6da26e822e09 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:13.664607 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-2a7a8f73-68dd-471e-9581-6da26e822e09 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:13.670450 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2a7a8f73-68dd-471e-9581-6da26e822e09 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:13.670898 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2a7a8f73-68dd-471e-9581-6da26e822e09 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:13.671667 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2a7a8f73-68dd-471e-9581-6da26e822e09 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:13.672104 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2a7a8f73-68dd-471e-9581-6da26e822e09 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:13.744035 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-2a7a8f73-68dd-471e-9581-6da26e822e09 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.084271 Nov 23 14:39:13.744618 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 572/1137] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:13 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:14.416252 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-45afa03e-2858-427f-b71a-189695d98bc4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:14.416957 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-45afa03e-2858-427f-b71a-189695d98bc4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:14.423119 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45afa03e-2858-427f-b71a-189695d98bc4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:14.423564 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45afa03e-2858-427f-b71a-189695d98bc4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:14.424474 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45afa03e-2858-427f-b71a-189695d98bc4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:14.425101 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45afa03e-2858-427f-b71a-189695d98bc4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:14.500214 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5cc46b28-baea-4555-9043-acd1a6f353d0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:14.501125 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5cc46b28-baea-4555-9043-acd1a6f353d0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:14.508176 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5cc46b28-baea-4555-9043-acd1a6f353d0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:14.508650 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5cc46b28-baea-4555-9043-acd1a6f353d0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:14.509424 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5cc46b28-baea-4555-9043-acd1a6f353d0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:14.509857 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5cc46b28-baea-4555-9043-acd1a6f353d0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:14.568209 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-45afa03e-2858-427f-b71a-189695d98bc4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:14.575996 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-45afa03e-2858-427f-b71a-189695d98bc4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1756 microversion: 2.1 time: 0.163428 Nov 23 14:39:14.576600 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 566/1138] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:14 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:14.713376 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5cc46b28-baea-4555-9043-acd1a6f353d0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:14.720804 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5cc46b28-baea-4555-9043-acd1a6f353d0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1674 microversion: 2.1 time: 0.224724 Nov 23 14:39:14.721365 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 573/1139] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:14 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1674 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:39:14.755639 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-553f3ebc-2c29-4a12-acac-4529f6f84042 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:14.756634 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-553f3ebc-2c29-4a12-acac-4529f6f84042 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:14.762664 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-553f3ebc-2c29-4a12-acac-4529f6f84042 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:14.763037 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-553f3ebc-2c29-4a12-acac-4529f6f84042 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:14.763806 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-553f3ebc-2c29-4a12-acac-4529f6f84042 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:14.764246 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-553f3ebc-2c29-4a12-acac-4529f6f84042 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:14.837034 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-553f3ebc-2c29-4a12-acac-4529f6f84042 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.085680 Nov 23 14:39:14.840993 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 567/1140] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:14 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:15.529304 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-9755e029-c048-4dce-b482-2a09135fa32e req-527cfaf1-6306-4e94-b4bf-894c286910e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace5aa86-e88f-49e1-b497-966c499eba99", "name": "network-vif-deleted", "tag": "ede71cd5-6bc1-4eed-a9a6-c4d4c9fe08fc"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:15.532511 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:39:15.532511 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:39:15.540644 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-9755e029-c048-4dce-b482-2a09135fa32e req-527cfaf1-6306-4e94-b4bf-894c286910e9 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:15.541184 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-9755e029-c048-4dce-b482-2a09135fa32e req-527cfaf1-6306-4e94-b4bf-894c286910e9 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:15.552579 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-9755e029-c048-4dce-b482-2a09135fa32e req-527cfaf1-6306-4e94-b4bf-894c286910e9 service nova] Creating event network-vif-deleted:ede71cd5-6bc1-4eed-a9a6-c4d4c9fe08fc for instance ace5aa86-e88f-49e1-b497-966c499eba99 on hv-cinder-80475 Nov 23 14:39:15.557411 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-9755e029-c048-4dce-b482-2a09135fa32e req-527cfaf1-6306-4e94-b4bf-894c286910e9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031783 Nov 23 14:39:15.559531 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 574/1141] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:39:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:39:15.595128 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-78a0e545-e3ae-4266-94a6-14662d9af81a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:15.596038 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-78a0e545-e3ae-4266-94a6-14662d9af81a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:15.608780 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-78a0e545-e3ae-4266-94a6-14662d9af81a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:15.609757 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-78a0e545-e3ae-4266-94a6-14662d9af81a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:15.610040 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-78a0e545-e3ae-4266-94a6-14662d9af81a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:15.610542 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-78a0e545-e3ae-4266-94a6-14662d9af81a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:15.741753 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-40918daa-500f-44ea-80ab-9d76463287ed tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:15.742421 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-40918daa-500f-44ea-80ab-9d76463287ed tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:15.749709 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-40918daa-500f-44ea-80ab-9d76463287ed tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:15.755811 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-40918daa-500f-44ea-80ab-9d76463287ed tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:15.755811 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-40918daa-500f-44ea-80ab-9d76463287ed tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:15.755811 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-40918daa-500f-44ea-80ab-9d76463287ed tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:15.778956 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-78a0e545-e3ae-4266-94a6-14662d9af81a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:15.788780 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-78a0e545-e3ae-4266-94a6-14662d9af81a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1756 microversion: 2.1 time: 0.197597 Nov 23 14:39:15.789617 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 568/1142] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:15 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:15.823889 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-40918daa-500f-44ea-80ab-9d76463287ed tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:15.832973 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-40918daa-500f-44ea-80ab-9d76463287ed tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 200 len: 1323 microversion: 2.1 time: 0.097616 Nov 23 14:39:15.834621 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 575/1143] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:15 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 1323 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:39:15.849389 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b3785686-a65d-428a-a473-fe73b653819a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:15.853516 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b3785686-a65d-428a-a473-fe73b653819a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:15.856760 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b3785686-a65d-428a-a473-fe73b653819a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:15.857211 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b3785686-a65d-428a-a473-fe73b653819a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:15.858006 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b3785686-a65d-428a-a473-fe73b653819a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:15.858443 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b3785686-a65d-428a-a473-fe73b653819a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:15.935064 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b3785686-a65d-428a-a473-fe73b653819a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.089889 Nov 23 14:39:15.939441 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 569/1144] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:15 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:16.806714 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-423add46-dd2e-41d5-9a2d-b2c4ae740b48 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:16.807271 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-423add46-dd2e-41d5-9a2d-b2c4ae740b48 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:16.813597 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-423add46-dd2e-41d5-9a2d-b2c4ae740b48 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:16.814040 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-423add46-dd2e-41d5-9a2d-b2c4ae740b48 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:16.816046 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-423add46-dd2e-41d5-9a2d-b2c4ae740b48 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:16.816262 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-423add46-dd2e-41d5-9a2d-b2c4ae740b48 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:16.851021 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-15ebc391-54a9-43bb-8914-b0e03524b438 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:16.851724 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-15ebc391-54a9-43bb-8914-b0e03524b438 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:16.859057 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-15ebc391-54a9-43bb-8914-b0e03524b438 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:16.859502 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-15ebc391-54a9-43bb-8914-b0e03524b438 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:16.860309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-15ebc391-54a9-43bb-8914-b0e03524b438 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:16.860762 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-15ebc391-54a9-43bb-8914-b0e03524b438 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:16.885793 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-15ebc391-54a9-43bb-8914-b0e03524b438 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] HTTP exception thrown: Instance ace5aa86-e88f-49e1-b497-966c499eba99 could not be found. Nov 23 14:39:16.886515 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-15ebc391-54a9-43bb-8914-b0e03524b438 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Returning 404 to user: Instance ace5aa86-e88f-49e1-b497-966c499eba99 could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:39:16.887440 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-15ebc391-54a9-43bb-8914-b0e03524b438 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 404 len: 111 microversion: 2.1 time: 0.040768 Nov 23 14:39:16.888089 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 570/1145] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:16 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 14:39:16.897181 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8916ac74-c7c4-4142-991b-7e082f084c25 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '.version_select at 0x7f2082fe7ee0>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:16.962274 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8916ac74-c7c4-4142-991b-7e082f084c25 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1765117141" status: 202 len: 0 microversion: 2.1 time: 0.069049 Nov 23 14:39:16.963701 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 571/1146] 10.222.0.82 () {58 vars in 1220 bytes} [Tue Nov 23 14:39:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1765117141 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:39:16.969849 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-423add46-dd2e-41d5-9a2d-b2c4ae740b48 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:16.971966 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e9df17cb-a3ea-4b58-afa5-fe4baa0d49ea tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:16.973123 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e9df17cb-a3ea-4b58-afa5-fe4baa0d49ea tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:16.978782 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-423add46-dd2e-41d5-9a2d-b2c4ae740b48 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1756 microversion: 2.1 time: 0.175863 Nov 23 14:39:16.979349 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 576/1147] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:16 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:16.979881 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e9df17cb-a3ea-4b58-afa5-fe4baa0d49ea tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:16.980352 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e9df17cb-a3ea-4b58-afa5-fe4baa0d49ea tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:16.981153 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e9df17cb-a3ea-4b58-afa5-fe4baa0d49ea tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:16.981580 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e9df17cb-a3ea-4b58-afa5-fe4baa0d49ea tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:17.045121 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e9df17cb-a3ea-4b58-afa5-fe4baa0d49ea tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.080636 Nov 23 14:39:17.049074 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 572/1148] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:16 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:17.745120 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5b45fdc1-2121-4c87-a57a-ecb9280ee001 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'create', calling method: .version_select at 0x7f208c011790>, body: {"keypair": {"name": "tempest-keypair-1082061902"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:17.759130 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-5b45fdc1-2121-4c87-a57a-ecb9280ee001 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Getting quotas for project 6cd08103499348da976aa1b8d926a748. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:39:17.762810 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-5b45fdc1-2121-4c87-a57a-ecb9280ee001 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Getting quotas for user 65b0720c8f9b47888a5e315c01ac65bb and project 6cd08103499348da976aa1b8d926a748. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:39:17.918827 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-5b45fdc1-2121-4c87-a57a-ecb9280ee001 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Getting quotas for project 6cd08103499348da976aa1b8d926a748. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:39:17.922259 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-5b45fdc1-2121-4c87-a57a-ecb9280ee001 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Getting quotas for user 65b0720c8f9b47888a5e315c01ac65bb and project 6cd08103499348da976aa1b8d926a748. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:39:17.934694 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5b45fdc1-2121-4c87-a57a-ecb9280ee001 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.193226 Nov 23 14:39:17.935284 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 577/1149] 10.222.0.82 () {60 vars in 1157 bytes} [Tue Nov 23 14:39:17 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:17.997719 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c52cbdfc-651c-47eb-8c9f-22af2e946490 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:17.998451 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c52cbdfc-651c-47eb-8c9f-22af2e946490 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:18.006366 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c52cbdfc-651c-47eb-8c9f-22af2e946490 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:18.006819 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c52cbdfc-651c-47eb-8c9f-22af2e946490 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:18.007602 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c52cbdfc-651c-47eb-8c9f-22af2e946490 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:18.008038 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c52cbdfc-651c-47eb-8c9f-22af2e946490 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:18.056957 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-896ef101-e4d4-43c5-ada0-555073707bee tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:18.057928 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-896ef101-e4d4-43c5-ada0-555073707bee tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:18.063774 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-896ef101-e4d4-43c5-ada0-555073707bee tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:18.064223 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-896ef101-e4d4-43c5-ada0-555073707bee tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:18.065029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-896ef101-e4d4-43c5-ada0-555073707bee tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:18.066009 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-896ef101-e4d4-43c5-ada0-555073707bee tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:18.128520 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-896ef101-e4d4-43c5-ada0-555073707bee tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.074561 Nov 23 14:39:18.129436 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 578/1150] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:18 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:39:18.192049 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c52cbdfc-651c-47eb-8c9f-22af2e946490 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:18.200749 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c52cbdfc-651c-47eb-8c9f-22af2e946490 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1756 microversion: 2.1 time: 0.207337 Nov 23 14:39:18.201310 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 573/1151] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:17 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1756 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:19.140969 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ee37bbc4-b622-4eff-9413-5cf1f3280fe4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:19.142044 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ee37bbc4-b622-4eff-9413-5cf1f3280fe4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:19.149765 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ee37bbc4-b622-4eff-9413-5cf1f3280fe4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:19.159801 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ee37bbc4-b622-4eff-9413-5cf1f3280fe4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:19.159801 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ee37bbc4-b622-4eff-9413-5cf1f3280fe4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:19.159801 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ee37bbc4-b622-4eff-9413-5cf1f3280fe4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:19.211988 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ee37bbc4-b622-4eff-9413-5cf1f3280fe4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.075030 Nov 23 14:39:19.213544 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 579/1152] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:19 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:19.217862 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ffcb3d2b-63eb-4c13-91f5-500cce036577 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:19.218472 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ffcb3d2b-63eb-4c13-91f5-500cce036577 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:19.224937 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ffcb3d2b-63eb-4c13-91f5-500cce036577 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:19.225388 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ffcb3d2b-63eb-4c13-91f5-500cce036577 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:19.226167 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ffcb3d2b-63eb-4c13-91f5-500cce036577 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:19.226603 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ffcb3d2b-63eb-4c13-91f5-500cce036577 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:19.460832 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ffcb3d2b-63eb-4c13-91f5-500cce036577 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:19.468555 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ffcb3d2b-63eb-4c13-91f5-500cce036577 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1756 microversion: 2.1 time: 0.254268 Nov 23 14:39:19.471572 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 574/1153] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:19 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1756 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:20.224534 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f49534f4-5c20-49c1-a2be-4a8c9d4f0763 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:20.225787 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f49534f4-5c20-49c1-a2be-4a8c9d4f0763 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:20.232118 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9d1d315d-d846-4828-81d3-b94a8491c0c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1086022049", "imageRef": "b06b9241-c147-436d-86bb-7c49ad8ef09c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75dee0cb-c425-47a6-a181-354dcf25b3e5"}], "security_groups": [{"name": "tempest-securitygroup--1749613472"}], "key_name": "tempest-keypair-1082061902", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:20.233534 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f49534f4-5c20-49c1-a2be-4a8c9d4f0763 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:20.234056 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f49534f4-5c20-49c1-a2be-4a8c9d4f0763 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:20.234915 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f49534f4-5c20-49c1-a2be-4a8c9d4f0763 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:20.235485 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f49534f4-5c20-49c1-a2be-4a8c9d4f0763 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:20.305108 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f49534f4-5c20-49c1-a2be-4a8c9d4f0763 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.085060 Nov 23 14:39:20.309070 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 580/1154] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:20 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:20.339701 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.network.neutron [None req-9d1d315d-d846-4828-81d3-b94a8491c0c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] validate_networks() for [('75dee0cb-c425-47a6-a181-354dcf25b3e5', None, None, None, None, None)] {{(pid=116787) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:39:20.487443 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-03bb1a4a-6874-4002-8b82-92ea0ec30a97 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:20.488349 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-03bb1a4a-6874-4002-8b82-92ea0ec30a97 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:20.495131 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-03bb1a4a-6874-4002-8b82-92ea0ec30a97 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:20.495781 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-03bb1a4a-6874-4002-8b82-92ea0ec30a97 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:20.496588 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-03bb1a4a-6874-4002-8b82-92ea0ec30a97 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:20.497026 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-03bb1a4a-6874-4002-8b82-92ea0ec30a97 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:20.642296 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-03bb1a4a-6874-4002-8b82-92ea0ec30a97 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:20.650315 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-03bb1a4a-6874-4002-8b82-92ea0ec30a97 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1756 microversion: 2.1 time: 0.167442 Nov 23 14:39:20.650885 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 581/1155] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:20 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:39:20.695242 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-9d1d315d-d846-4828-81d3-b94a8491c0c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Flavor limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:39:20.695665 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-9d1d315d-d846-4828-81d3-b94a8491c0c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Image limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:39:20.696168 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-9d1d315d-d846-4828-81d3-b94a8491c0c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Flavor pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:39:20.696635 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-9d1d315d-d846-4828-81d3-b94a8491c0c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Image pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:39:20.697056 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-9d1d315d-d846-4828-81d3-b94a8491c0c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:39:20.705526 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9d1d315d-d846-4828-81d3-b94a8491c0c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:20.706613 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9d1d315d-d846-4828-81d3-b94a8491c0c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:20.706950 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9d1d315d-d846-4828-81d3-b94a8491c0c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:20.707392 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9d1d315d-d846-4828-81d3-b94a8491c0c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:20.723600 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-9d1d315d-d846-4828-81d3-b94a8491c0c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Getting quotas for project 6cd08103499348da976aa1b8d926a748. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:39:20.727425 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-9d1d315d-d846-4828-81d3-b94a8491c0c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Getting quotas for user 65b0720c8f9b47888a5e315c01ac65bb and project 6cd08103499348da976aa1b8d926a748. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:39:20.738712 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9d1d315d-d846-4828-81d3-b94a8491c0c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Going to run 1 instances... {{(pid=116787) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:39:20.741042 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9d1d315d-d846-4828-81d3-b94a8491c0c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b06b9241-c147-436d-86bb-7c49ad8ef09c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:39:20.847838 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9d1d315d-d846-4828-81d3-b94a8491c0c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.619835 Nov 23 14:39:20.848528 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 575/1156] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:39:20 2021] POST /compute/v2.1/servers => generated 402 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 14:39:20.858279 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bc63a0c4-349f-43c0-9d56-e41a3a3b7c93 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:20.858883 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bc63a0c4-349f-43c0-9d56-e41a3a3b7c93 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:20.914909 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-bc63a0c4-349f-43c0-9d56-e41a3a3b7c93 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:20.921977 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bc63a0c4-349f-43c0-9d56-e41a3a3b7c93 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 200 len: 1238 microversion: 2.1 time: 0.067244 Nov 23 14:39:20.922597 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 582/1157] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:20 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:21.316585 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d822ff7a-1697-4c60-8a3d-57eafc2ded16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:21.317565 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d822ff7a-1697-4c60-8a3d-57eafc2ded16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:21.323436 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d822ff7a-1697-4c60-8a3d-57eafc2ded16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:21.332525 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d822ff7a-1697-4c60-8a3d-57eafc2ded16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:21.332525 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d822ff7a-1697-4c60-8a3d-57eafc2ded16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:21.332525 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d822ff7a-1697-4c60-8a3d-57eafc2ded16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:21.394560 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d822ff7a-1697-4c60-8a3d-57eafc2ded16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.081862 Nov 23 14:39:21.398786 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 576/1158] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:21 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:21.667244 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-23f7c03e-c3c5-480b-8ad0-183ab13affa7 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:21.667842 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-23f7c03e-c3c5-480b-8ad0-183ab13affa7 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:21.674325 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-23f7c03e-c3c5-480b-8ad0-183ab13affa7 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:21.674581 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-23f7c03e-c3c5-480b-8ad0-183ab13affa7 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:21.675367 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-23f7c03e-c3c5-480b-8ad0-183ab13affa7 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:21.675796 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-23f7c03e-c3c5-480b-8ad0-183ab13affa7 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:21.820257 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-23f7c03e-c3c5-480b-8ad0-183ab13affa7 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:21.828174 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-23f7c03e-c3c5-480b-8ad0-183ab13affa7 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1759 microversion: 2.1 time: 0.164616 Nov 23 14:39:21.828759 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 583/1159] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:21 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:39:21.940506 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ff998dc4-ecd4-47b5-b2d1-64269d4107bb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:21.941309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ff998dc4-ecd4-47b5-b2d1-64269d4107bb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:21.948382 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ff998dc4-ecd4-47b5-b2d1-64269d4107bb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:21.948833 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ff998dc4-ecd4-47b5-b2d1-64269d4107bb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:21.949647 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ff998dc4-ecd4-47b5-b2d1-64269d4107bb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:21.950078 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ff998dc4-ecd4-47b5-b2d1-64269d4107bb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:22.014206 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ff998dc4-ecd4-47b5-b2d1-64269d4107bb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:22.022231 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ff998dc4-ecd4-47b5-b2d1-64269d4107bb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 200 len: 1242 microversion: 2.1 time: 0.086458 Nov 23 14:39:22.022603 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 577/1160] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:21 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:22.406473 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e7e1ccd0-8552-49db-b73e-0df6739740b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:22.407429 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e7e1ccd0-8552-49db-b73e-0df6739740b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:22.413676 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e7e1ccd0-8552-49db-b73e-0df6739740b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:22.414122 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e7e1ccd0-8552-49db-b73e-0df6739740b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:22.414889 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e7e1ccd0-8552-49db-b73e-0df6739740b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:22.415320 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e7e1ccd0-8552-49db-b73e-0df6739740b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:22.485694 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e7e1ccd0-8552-49db-b73e-0df6739740b4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.082749 Nov 23 14:39:22.486341 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 584/1161] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:22 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:23.039553 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-19b02cfb-4d29-4074-b156-2542b0c9d74a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:23.040846 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-19b02cfb-4d29-4074-b156-2542b0c9d74a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:23.047848 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-19b02cfb-4d29-4074-b156-2542b0c9d74a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:23.048322 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-19b02cfb-4d29-4074-b156-2542b0c9d74a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:23.049704 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-19b02cfb-4d29-4074-b156-2542b0c9d74a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:23.050144 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-19b02cfb-4d29-4074-b156-2542b0c9d74a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:23.111090 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-19b02cfb-4d29-4074-b156-2542b0c9d74a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:23.118934 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-19b02cfb-4d29-4074-b156-2542b0c9d74a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 200 len: 1296 microversion: 2.1 time: 0.083261 Nov 23 14:39:23.119492 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 578/1162] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:23 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:23.498026 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ae922170-fb32-45c1-bd12-4c8c21d60e4a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:23.499026 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ae922170-fb32-45c1-bd12-4c8c21d60e4a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:23.507327 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ae922170-fb32-45c1-bd12-4c8c21d60e4a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:23.507864 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ae922170-fb32-45c1-bd12-4c8c21d60e4a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:23.508925 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ae922170-fb32-45c1-bd12-4c8c21d60e4a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:23.509601 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ae922170-fb32-45c1-bd12-4c8c21d60e4a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:23.651841 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ae922170-fb32-45c1-bd12-4c8c21d60e4a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.157801 Nov 23 14:39:23.652865 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 585/1163] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:23 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:24.136171 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1af58c96-9b97-4ed6-8167-fe19560ad299 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:24.137603 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1af58c96-9b97-4ed6-8167-fe19560ad299 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:24.145721 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1af58c96-9b97-4ed6-8167-fe19560ad299 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:24.146449 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1af58c96-9b97-4ed6-8167-fe19560ad299 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:24.147631 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1af58c96-9b97-4ed6-8167-fe19560ad299 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:24.148352 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1af58c96-9b97-4ed6-8167-fe19560ad299 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:24.291247 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-1af58c96-9b97-4ed6-8167-fe19560ad299 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:24.299129 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1af58c96-9b97-4ed6-8167-fe19560ad299 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 200 len: 1364 microversion: 2.1 time: 0.166342 Nov 23 14:39:24.308578 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 579/1164] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:24 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:24.319217 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-95cc4b03-1382-4968-963c-10746db1be58 req-14b2b293-5c09-4d4b-8d42-94ac6b98701a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07539cec-d8ef-485e-84d8-9bd690c4397e", "tag": "6955538e-583a-4e78-9edb-e27c4276b423"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:24.320770 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:39:24.320770 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:39:24.329280 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-95cc4b03-1382-4968-963c-10746db1be58 req-14b2b293-5c09-4d4b-8d42-94ac6b98701a service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:24.329691 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-95cc4b03-1382-4968-963c-10746db1be58 req-14b2b293-5c09-4d4b-8d42-94ac6b98701a service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:24.347675 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-95cc4b03-1382-4968-963c-10746db1be58 req-14b2b293-5c09-4d4b-8d42-94ac6b98701a service nova] Creating event network-changed:6955538e-583a-4e78-9edb-e27c4276b423 for instance 07539cec-d8ef-485e-84d8-9bd690c4397e on hv-cinder-80475 Nov 23 14:39:24.352794 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-95cc4b03-1382-4968-963c-10746db1be58 req-14b2b293-5c09-4d4b-8d42-94ac6b98701a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037864 Nov 23 14:39:24.354155 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 586/1165] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:39:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:39:24.663164 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-45ba44de-1cdf-45a3-82db-7f94a97789fb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:24.664176 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-45ba44de-1cdf-45a3-82db-7f94a97789fb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:24.670443 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45ba44de-1cdf-45a3-82db-7f94a97789fb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:24.670898 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45ba44de-1cdf-45a3-82db-7f94a97789fb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:24.671689 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45ba44de-1cdf-45a3-82db-7f94a97789fb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:24.672127 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-45ba44de-1cdf-45a3-82db-7f94a97789fb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:24.743010 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-45ba44de-1cdf-45a3-82db-7f94a97789fb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.083449 Nov 23 14:39:24.743766 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 580/1166] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:24 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:25.315849 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f516b24b-98a5-4070-bf63-72b6661a00e0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:25.316588 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f516b24b-98a5-4070-bf63-72b6661a00e0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:25.323269 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f516b24b-98a5-4070-bf63-72b6661a00e0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:25.323719 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f516b24b-98a5-4070-bf63-72b6661a00e0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:25.324526 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f516b24b-98a5-4070-bf63-72b6661a00e0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:25.324962 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f516b24b-98a5-4070-bf63-72b6661a00e0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:25.459691 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-f516b24b-98a5-4070-bf63-72b6661a00e0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:25.466854 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f516b24b-98a5-4070-bf63-72b6661a00e0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 200 len: 1364 microversion: 2.1 time: 0.155643 Nov 23 14:39:25.467422 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 587/1167] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:25 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:25.756300 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-245e02eb-e3d5-44d2-96cd-95225b17d990 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:25.757299 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-245e02eb-e3d5-44d2-96cd-95225b17d990 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:25.764207 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-245e02eb-e3d5-44d2-96cd-95225b17d990 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:25.764686 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-245e02eb-e3d5-44d2-96cd-95225b17d990 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:25.765466 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-245e02eb-e3d5-44d2-96cd-95225b17d990 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:25.765903 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-245e02eb-e3d5-44d2-96cd-95225b17d990 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:25.828203 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-245e02eb-e3d5-44d2-96cd-95225b17d990 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.076551 Nov 23 14:39:25.828866 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 581/1168] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:25 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:26.482663 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-384976ed-85e6-4144-9925-10cf051c28e1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:26.483321 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-384976ed-85e6-4144-9925-10cf051c28e1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:26.489809 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-384976ed-85e6-4144-9925-10cf051c28e1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:26.490260 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-384976ed-85e6-4144-9925-10cf051c28e1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:26.491019 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-384976ed-85e6-4144-9925-10cf051c28e1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:26.491448 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-384976ed-85e6-4144-9925-10cf051c28e1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:26.622031 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-384976ed-85e6-4144-9925-10cf051c28e1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:26.629368 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-384976ed-85e6-4144-9925-10cf051c28e1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 200 len: 1364 microversion: 2.1 time: 0.150352 Nov 23 14:39:26.629923 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 588/1169] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:26 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:26.840560 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6c0bdd06-fc59-4322-9d4b-d53327aaa9b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:26.841553 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6c0bdd06-fc59-4322-9d4b-d53327aaa9b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:26.848672 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c0bdd06-fc59-4322-9d4b-d53327aaa9b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:26.849123 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c0bdd06-fc59-4322-9d4b-d53327aaa9b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:26.849903 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c0bdd06-fc59-4322-9d4b-d53327aaa9b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:26.850338 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6c0bdd06-fc59-4322-9d4b-d53327aaa9b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:26.914793 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6c0bdd06-fc59-4322-9d4b-d53327aaa9b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.078199 Nov 23 14:39:26.918555 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 582/1170] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:26 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:27.646348 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1c7d15aa-ef6d-47de-9102-6175c507555a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:27.646882 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1c7d15aa-ef6d-47de-9102-6175c507555a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:27.653157 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1c7d15aa-ef6d-47de-9102-6175c507555a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:27.653599 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1c7d15aa-ef6d-47de-9102-6175c507555a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:27.654366 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1c7d15aa-ef6d-47de-9102-6175c507555a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:27.654800 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1c7d15aa-ef6d-47de-9102-6175c507555a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:27.787802 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1c7d15aa-ef6d-47de-9102-6175c507555a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:27.791148 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1c7d15aa-ef6d-47de-9102-6175c507555a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 200 len: 1364 microversion: 2.1 time: 0.148593 Nov 23 14:39:27.791741 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 589/1171] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:27 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:27.927024 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3961ce84-de41-4814-9df7-3d26a11fc146 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:27.927913 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3961ce84-de41-4814-9df7-3d26a11fc146 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:27.934732 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3961ce84-de41-4814-9df7-3d26a11fc146 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:27.935177 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3961ce84-de41-4814-9df7-3d26a11fc146 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:27.935942 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3961ce84-de41-4814-9df7-3d26a11fc146 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:27.936400 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3961ce84-de41-4814-9df7-3d26a11fc146 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:28.012484 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3961ce84-de41-4814-9df7-3d26a11fc146 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.089705 Nov 23 14:39:28.013086 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 583/1172] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:27 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:39:28.808564 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1116d321-ca2a-473c-bc59-c48f4155b4e1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:28.809178 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1116d321-ca2a-473c-bc59-c48f4155b4e1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:28.815760 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1116d321-ca2a-473c-bc59-c48f4155b4e1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:28.816208 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1116d321-ca2a-473c-bc59-c48f4155b4e1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:28.817073 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1116d321-ca2a-473c-bc59-c48f4155b4e1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:28.817503 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1116d321-ca2a-473c-bc59-c48f4155b4e1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:28.949255 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1116d321-ca2a-473c-bc59-c48f4155b4e1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:28.956929 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1116d321-ca2a-473c-bc59-c48f4155b4e1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 200 len: 1364 microversion: 2.1 time: 0.151985 Nov 23 14:39:28.957484 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 590/1173] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:28 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:29.026083 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8b6afe64-9eb7-46e6-aea1-a374a042d22a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:29.027139 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8b6afe64-9eb7-46e6-aea1-a374a042d22a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:29.034258 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8b6afe64-9eb7-46e6-aea1-a374a042d22a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:29.034709 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8b6afe64-9eb7-46e6-aea1-a374a042d22a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:29.035495 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8b6afe64-9eb7-46e6-aea1-a374a042d22a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:29.035931 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8b6afe64-9eb7-46e6-aea1-a374a042d22a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:29.096949 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8b6afe64-9eb7-46e6-aea1-a374a042d22a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.075468 Nov 23 14:39:29.097842 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 584/1174] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:29 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:29.973726 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a22ba382-1d94-483a-8257-737a09e44017 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:29.974314 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a22ba382-1d94-483a-8257-737a09e44017 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:29.980626 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a22ba382-1d94-483a-8257-737a09e44017 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:29.981063 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a22ba382-1d94-483a-8257-737a09e44017 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:29.981833 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a22ba382-1d94-483a-8257-737a09e44017 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:29.982258 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a22ba382-1d94-483a-8257-737a09e44017 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:30.109208 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d65e0b22-d27a-454d-a505-b94385c1a480 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:30.110196 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d65e0b22-d27a-454d-a505-b94385c1a480 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:30.111601 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a22ba382-1d94-483a-8257-737a09e44017 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:30.117989 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d65e0b22-d27a-454d-a505-b94385c1a480 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:30.118435 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d65e0b22-d27a-454d-a505-b94385c1a480 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:30.119053 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a22ba382-1d94-483a-8257-737a09e44017 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 200 len: 1364 microversion: 2.1 time: 0.149572 Nov 23 14:39:30.119224 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d65e0b22-d27a-454d-a505-b94385c1a480 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:30.119634 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 591/1175] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:29 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:30.119752 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d65e0b22-d27a-454d-a505-b94385c1a480 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:30.195622 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d65e0b22-d27a-454d-a505-b94385c1a480 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.090289 Nov 23 14:39:30.196255 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 585/1176] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:30 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:39:30.844181 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-48810f92-1285-481d-83bd-bf128a49e938 req-53af34af-6944-4ebf-8747-8906728447cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07539cec-d8ef-485e-84d8-9bd690c4397e", "name": "network-vif-plugged", "status": "completed", "tag": "6955538e-583a-4e78-9edb-e27c4276b423"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:30.846362 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:39:30.846362 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:39:30.853803 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-48810f92-1285-481d-83bd-bf128a49e938 req-53af34af-6944-4ebf-8747-8906728447cd service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:30.854298 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-48810f92-1285-481d-83bd-bf128a49e938 req-53af34af-6944-4ebf-8747-8906728447cd service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:30.867034 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-48810f92-1285-481d-83bd-bf128a49e938 req-53af34af-6944-4ebf-8747-8906728447cd service nova] Creating event network-vif-plugged:6955538e-583a-4e78-9edb-e27c4276b423 for instance 07539cec-d8ef-485e-84d8-9bd690c4397e on hv-cinder-80475 Nov 23 14:39:30.871880 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-48810f92-1285-481d-83bd-bf128a49e938 req-53af34af-6944-4ebf-8747-8906728447cd service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031449 Nov 23 14:39:30.872511 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 592/1177] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:39:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:39:31.138388 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-617e9e3a-d8a7-4a4d-9095-a1efde020e72 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:31.139170 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-617e9e3a-d8a7-4a4d-9095-a1efde020e72 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:31.146731 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-617e9e3a-d8a7-4a4d-9095-a1efde020e72 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:31.147183 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-617e9e3a-d8a7-4a4d-9095-a1efde020e72 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:31.147964 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-617e9e3a-d8a7-4a4d-9095-a1efde020e72 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:31.148427 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-617e9e3a-d8a7-4a4d-9095-a1efde020e72 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:31.208193 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-8717f3b4-1751-49d1-9642-edf793966cfc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:31.209217 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-8717f3b4-1751-49d1-9642-edf793966cfc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:31.216025 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8717f3b4-1751-49d1-9642-edf793966cfc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:31.216500 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8717f3b4-1751-49d1-9642-edf793966cfc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:31.217314 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8717f3b4-1751-49d1-9642-edf793966cfc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:31.217699 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8717f3b4-1751-49d1-9642-edf793966cfc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:31.281614 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-8717f3b4-1751-49d1-9642-edf793966cfc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.077787 Nov 23 14:39:31.285887 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 593/1178] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:31 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:39:31.326811 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-617e9e3a-d8a7-4a4d-9095-a1efde020e72 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:31.335225 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-617e9e3a-d8a7-4a4d-9095-a1efde020e72 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 200 len: 1364 microversion: 2.1 time: 0.201179 Nov 23 14:39:31.335840 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 586/1179] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:31 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:32.294551 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1dce1caa-32e4-4375-bb70-a6ff8b589240 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:32.295583 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1dce1caa-32e4-4375-bb70-a6ff8b589240 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:32.303409 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1dce1caa-32e4-4375-bb70-a6ff8b589240 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:32.303852 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1dce1caa-32e4-4375-bb70-a6ff8b589240 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:32.304641 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1dce1caa-32e4-4375-bb70-a6ff8b589240 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:32.305080 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1dce1caa-32e4-4375-bb70-a6ff8b589240 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:32.352027 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5f68d461-2f23-4c44-92bf-f34d4c570c01 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:32.352671 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5f68d461-2f23-4c44-92bf-f34d4c570c01 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:32.358796 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5f68d461-2f23-4c44-92bf-f34d4c570c01 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:32.359238 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5f68d461-2f23-4c44-92bf-f34d4c570c01 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:32.360002 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5f68d461-2f23-4c44-92bf-f34d4c570c01 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:32.360458 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5f68d461-2f23-4c44-92bf-f34d4c570c01 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:32.376261 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1dce1caa-32e4-4375-bb70-a6ff8b589240 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.085986 Nov 23 14:39:32.377466 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 594/1180] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:32 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:32.490405 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5f68d461-2f23-4c44-92bf-f34d4c570c01 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:32.497482 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5f68d461-2f23-4c44-92bf-f34d4c570c01 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 200 len: 1364 microversion: 2.1 time: 0.149099 Nov 23 14:39:32.498038 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 587/1181] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:32 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:39:33.388856 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5143737f-765d-4820-ba80-ec7ec316c8ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:33.389838 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5143737f-765d-4820-ba80-ec7ec316c8ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:33.396745 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5143737f-765d-4820-ba80-ec7ec316c8ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:33.397192 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5143737f-765d-4820-ba80-ec7ec316c8ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:33.397968 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5143737f-765d-4820-ba80-ec7ec316c8ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:33.398401 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5143737f-765d-4820-ba80-ec7ec316c8ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:33.473017 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5143737f-765d-4820-ba80-ec7ec316c8ec tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28656 microversion: 2.20 time: 0.088131 Nov 23 14:39:33.473629 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 595/1182] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:33 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28656 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:33.513763 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-533ff74d-3372-46fa-b44b-83f0383ea544 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:33.514371 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-533ff74d-3372-46fa-b44b-83f0383ea544 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:33.520733 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-533ff74d-3372-46fa-b44b-83f0383ea544 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:33.521176 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-533ff74d-3372-46fa-b44b-83f0383ea544 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:33.521939 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-533ff74d-3372-46fa-b44b-83f0383ea544 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:33.522369 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-533ff74d-3372-46fa-b44b-83f0383ea544 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:33.888863 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-533ff74d-3372-46fa-b44b-83f0383ea544 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:33.896109 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-533ff74d-3372-46fa-b44b-83f0383ea544 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 200 len: 1549 microversion: 2.1 time: 0.385992 Nov 23 14:39:33.896717 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 588/1183] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:39:33 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 1549 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:33.912844 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5788a843-dbc3-4b7f-bdbb-f62faecc303b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:33.913418 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5788a843-dbc3-4b7f-bdbb-f62faecc303b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:33.920172 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5788a843-dbc3-4b7f-bdbb-f62faecc303b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:33.920650 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5788a843-dbc3-4b7f-bdbb-f62faecc303b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:33.921415 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5788a843-dbc3-4b7f-bdbb-f62faecc303b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:33.921848 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5788a843-dbc3-4b7f-bdbb-f62faecc303b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:34.004678 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5788a843-dbc3-4b7f-bdbb-f62faecc303b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095895 Nov 23 14:39:34.005344 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 596/1184] 10.222.0.82 () {58 vars in 1274 bytes} [Tue Nov 23 14:39:33 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:39:34.484741 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-01883700-4e7c-4dab-ba45-2a5e04741abf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:34.485890 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-01883700-4e7c-4dab-ba45-2a5e04741abf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:34.492114 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-01883700-4e7c-4dab-ba45-2a5e04741abf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:34.495830 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-01883700-4e7c-4dab-ba45-2a5e04741abf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:34.495830 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-01883700-4e7c-4dab-ba45-2a5e04741abf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:34.495830 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-01883700-4e7c-4dab-ba45-2a5e04741abf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:34.584778 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-01883700-4e7c-4dab-ba45-2a5e04741abf tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 28795 microversion: 2.20 time: 0.103665 Nov 23 14:39:34.585861 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 589/1185] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:34 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 28795 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:34.986514 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-007a334a-2f8d-4173-82af-a1be34401ec5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:34.987407 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-007a334a-2f8d-4173-82af-a1be34401ec5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:34.989474 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-46db011b-504d-432d-9611-cc2479e4d880 req-308df752-29f0-428f-a92e-e0b827f24505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07539cec-d8ef-485e-84d8-9bd690c4397e", "tag": "6955538e-583a-4e78-9edb-e27c4276b423"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:34.991032 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:39:34.991032 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:39:34.993925 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-007a334a-2f8d-4173-82af-a1be34401ec5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:34.994365 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-007a334a-2f8d-4173-82af-a1be34401ec5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:34.995134 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-007a334a-2f8d-4173-82af-a1be34401ec5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:34.995559 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-007a334a-2f8d-4173-82af-a1be34401ec5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:35.000019 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-46db011b-504d-432d-9611-cc2479e4d880 req-308df752-29f0-428f-a92e-e0b827f24505 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:35.000561 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-46db011b-504d-432d-9611-cc2479e4d880 req-308df752-29f0-428f-a92e-e0b827f24505 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:35.013726 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-46db011b-504d-432d-9611-cc2479e4d880 req-308df752-29f0-428f-a92e-e0b827f24505 service nova] Creating event network-changed:6955538e-583a-4e78-9edb-e27c4276b423 for instance 07539cec-d8ef-485e-84d8-9bd690c4397e on hv-cinder-80475 Nov 23 14:39:35.018756 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-46db011b-504d-432d-9611-cc2479e4d880 req-308df752-29f0-428f-a92e-e0b827f24505 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033887 Nov 23 14:39:35.019453 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 590/1186] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:39:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:39:35.066674 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-007a334a-2f8d-4173-82af-a1be34401ec5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 14 microversion: 2.1 time: 0.084510 Nov 23 14:39:35.067306 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 597/1187] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:34 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:39:35.597557 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1542e417-5b16-44ae-8d2e-b670fcb7da7d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:35.598564 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1542e417-5b16-44ae-8d2e-b670fcb7da7d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:35.604766 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1542e417-5b16-44ae-8d2e-b670fcb7da7d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:35.605208 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1542e417-5b16-44ae-8d2e-b670fcb7da7d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:35.605980 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1542e417-5b16-44ae-8d2e-b670fcb7da7d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:35.606417 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1542e417-5b16-44ae-8d2e-b670fcb7da7d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:35.695338 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1542e417-5b16-44ae-8d2e-b670fcb7da7d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 30469 microversion: 2.20 time: 0.102186 Nov 23 14:39:35.699248 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 591/1188] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:35 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 30469 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:36.077960 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bd1fbf12-76cb-49d9-beaa-6812a04f6ae7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:36.079068 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bd1fbf12-76cb-49d9-beaa-6812a04f6ae7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:36.086670 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bd1fbf12-76cb-49d9-beaa-6812a04f6ae7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:36.087121 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bd1fbf12-76cb-49d9-beaa-6812a04f6ae7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:36.087910 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bd1fbf12-76cb-49d9-beaa-6812a04f6ae7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:36.088374 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bd1fbf12-76cb-49d9-beaa-6812a04f6ae7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:36.151265 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bd1fbf12-76cb-49d9-beaa-6812a04f6ae7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 14 microversion: 2.1 time: 0.077167 Nov 23 14:39:36.152060 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 598/1189] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:36 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:39:36.706735 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0f3cd905-25d2-4530-9f2a-e0e05b9dcb81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:36.707760 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0f3cd905-25d2-4530-9f2a-e0e05b9dcb81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:36.714663 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0f3cd905-25d2-4530-9f2a-e0e05b9dcb81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:36.715113 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0f3cd905-25d2-4530-9f2a-e0e05b9dcb81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:36.715890 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0f3cd905-25d2-4530-9f2a-e0e05b9dcb81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:36.716354 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0f3cd905-25d2-4530-9f2a-e0e05b9dcb81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:36.796720 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0f3cd905-25d2-4530-9f2a-e0e05b9dcb81 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 31883 microversion: 2.20 time: 0.093964 Nov 23 14:39:36.797345 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 592/1190] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:36 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 31883 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:37.163324 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-8433291c-cc46-4e8e-8109-5a06eee93c4d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:37.164332 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-8433291c-cc46-4e8e-8109-5a06eee93c4d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:37.171230 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8433291c-cc46-4e8e-8109-5a06eee93c4d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:37.171655 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8433291c-cc46-4e8e-8109-5a06eee93c4d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:37.172452 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8433291c-cc46-4e8e-8109-5a06eee93c4d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:37.172889 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8433291c-cc46-4e8e-8109-5a06eee93c4d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:37.233871 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-8433291c-cc46-4e8e-8109-5a06eee93c4d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 14 microversion: 2.1 time: 0.074503 Nov 23 14:39:37.234478 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 599/1191] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:37 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:39:37.809821 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-54f4b5b3-1f16-4427-bf52-aa716b78a525 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:37.810811 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-54f4b5b3-1f16-4427-bf52-aa716b78a525 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:37.818514 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-54f4b5b3-1f16-4427-bf52-aa716b78a525 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:37.818989 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-54f4b5b3-1f16-4427-bf52-aa716b78a525 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:37.819765 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-54f4b5b3-1f16-4427-bf52-aa716b78a525 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:37.820202 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-54f4b5b3-1f16-4427-bf52-aa716b78a525 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:37.910923 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-54f4b5b3-1f16-4427-bf52-aa716b78a525 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 32799 microversion: 2.20 time: 0.105248 Nov 23 14:39:37.911567 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 593/1192] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:37 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 32799 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:39:38.245600 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-18e68791-833d-41a7-bbdc-7dc0f086eaea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:38.246610 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-18e68791-833d-41a7-bbdc-7dc0f086eaea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:38.254121 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-18e68791-833d-41a7-bbdc-7dc0f086eaea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:38.254560 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-18e68791-833d-41a7-bbdc-7dc0f086eaea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:38.255323 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-18e68791-833d-41a7-bbdc-7dc0f086eaea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:38.255751 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-18e68791-833d-41a7-bbdc-7dc0f086eaea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:38.318139 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-18e68791-833d-41a7-bbdc-7dc0f086eaea tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 14 microversion: 2.1 time: 0.076327 Nov 23 14:39:38.318668 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 600/1193] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:38 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:39:38.923054 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-848d70f3-8bba-4887-a9cd-787a8f740e3c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:38.924645 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-848d70f3-8bba-4887-a9cd-787a8f740e3c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:38.931382 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-848d70f3-8bba-4887-a9cd-787a8f740e3c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:38.931826 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-848d70f3-8bba-4887-a9cd-787a8f740e3c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:38.932616 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-848d70f3-8bba-4887-a9cd-787a8f740e3c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:38.933054 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-848d70f3-8bba-4887-a9cd-787a8f740e3c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:39.022319 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-848d70f3-8bba-4887-a9cd-787a8f740e3c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 33700 microversion: 2.20 time: 0.103138 Nov 23 14:39:39.023222 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 594/1194] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:38 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 33700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:39.328845 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-113daf1f-9468-4359-b945-68a0cb9ca98f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:39.330453 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-113daf1f-9468-4359-b945-68a0cb9ca98f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:39.337276 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-113daf1f-9468-4359-b945-68a0cb9ca98f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:39.337720 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-113daf1f-9468-4359-b945-68a0cb9ca98f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:39.338492 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-113daf1f-9468-4359-b945-68a0cb9ca98f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:39.338923 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-113daf1f-9468-4359-b945-68a0cb9ca98f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:39.400183 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-113daf1f-9468-4359-b945-68a0cb9ca98f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 14 microversion: 2.1 time: 0.075165 Nov 23 14:39:39.400846 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 601/1195] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:39 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:39:40.034677 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c409cbc8-de88-4068-8e01-4ca3384eaeb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:40.035696 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c409cbc8-de88-4068-8e01-4ca3384eaeb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:40.042647 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c409cbc8-de88-4068-8e01-4ca3384eaeb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:40.043090 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c409cbc8-de88-4068-8e01-4ca3384eaeb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:40.043859 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c409cbc8-de88-4068-8e01-4ca3384eaeb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:40.044318 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c409cbc8-de88-4068-8e01-4ca3384eaeb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:40.139920 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c409cbc8-de88-4068-8e01-4ca3384eaeb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 34872 microversion: 2.20 time: 0.109265 Nov 23 14:39:40.140853 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 595/1196] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:40 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 34872 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:40.411577 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-0bcedccc-9b03-4e30-b465-9a3e78f289eb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:40.412597 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-0bcedccc-9b03-4e30-b465-9a3e78f289eb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:40.419572 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0bcedccc-9b03-4e30-b465-9a3e78f289eb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:40.420019 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0bcedccc-9b03-4e30-b465-9a3e78f289eb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:40.420811 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0bcedccc-9b03-4e30-b465-9a3e78f289eb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:40.421247 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0bcedccc-9b03-4e30-b465-9a3e78f289eb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:40.480006 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-0bcedccc-9b03-4e30-b465-9a3e78f289eb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 14 microversion: 2.1 time: 0.072597 Nov 23 14:39:40.480639 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 602/1197] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:40 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:39:41.153110 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c6439151-503b-49aa-b7a1-927dc2ad9c92 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:41.154101 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c6439151-503b-49aa-b7a1-927dc2ad9c92 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:41.161062 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c6439151-503b-49aa-b7a1-927dc2ad9c92 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:41.161514 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c6439151-503b-49aa-b7a1-927dc2ad9c92 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:41.162294 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c6439151-503b-49aa-b7a1-927dc2ad9c92 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:41.162730 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c6439151-503b-49aa-b7a1-927dc2ad9c92 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:41.246908 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c6439151-503b-49aa-b7a1-927dc2ad9c92 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 35964 microversion: 2.20 time: 0.097701 Nov 23 14:39:41.247503 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 596/1198] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:41 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 35964 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:41.492115 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b7baa883-67ed-4158-9a56-148f33cb89bc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:41.493126 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b7baa883-67ed-4158-9a56-148f33cb89bc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:41.500501 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b7baa883-67ed-4158-9a56-148f33cb89bc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:41.500949 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b7baa883-67ed-4158-9a56-148f33cb89bc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:41.502688 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b7baa883-67ed-4158-9a56-148f33cb89bc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:41.503124 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b7baa883-67ed-4158-9a56-148f33cb89bc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:41.569700 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b7baa883-67ed-4158-9a56-148f33cb89bc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 14 microversion: 2.1 time: 0.081586 Nov 23 14:39:41.570323 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 603/1199] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:41 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:39:42.259522 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-972eed9d-86d5-4e79-9a36-1653d71b433c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:42.260555 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-972eed9d-86d5-4e79-9a36-1653d71b433c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:42.267932 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-972eed9d-86d5-4e79-9a36-1653d71b433c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:42.268411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-972eed9d-86d5-4e79-9a36-1653d71b433c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:42.269184 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-972eed9d-86d5-4e79-9a36-1653d71b433c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:42.269617 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-972eed9d-86d5-4e79-9a36-1653d71b433c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:42.352394 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-972eed9d-86d5-4e79-9a36-1653d71b433c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 37209 microversion: 2.20 time: 0.096886 Nov 23 14:39:42.353397 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 597/1200] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:42 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 37209 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:42.581717 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a6658e88-b39d-4d20-80ff-2a4ff3b19ac5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:42.582704 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a6658e88-b39d-4d20-80ff-2a4ff3b19ac5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:42.589599 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a6658e88-b39d-4d20-80ff-2a4ff3b19ac5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:42.590040 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a6658e88-b39d-4d20-80ff-2a4ff3b19ac5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:42.590814 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a6658e88-b39d-4d20-80ff-2a4ff3b19ac5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:42.591243 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a6658e88-b39d-4d20-80ff-2a4ff3b19ac5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:42.658275 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a6658e88-b39d-4d20-80ff-2a4ff3b19ac5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 14 microversion: 2.1 time: 0.080315 Nov 23 14:39:42.658973 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 604/1201] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:42 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:39:43.364673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d7ecda4f-93fa-46ea-9bb1-d1409120d8b8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:43.365671 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d7ecda4f-93fa-46ea-9bb1-d1409120d8b8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:43.372762 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d7ecda4f-93fa-46ea-9bb1-d1409120d8b8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:43.373102 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d7ecda4f-93fa-46ea-9bb1-d1409120d8b8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:43.374152 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d7ecda4f-93fa-46ea-9bb1-d1409120d8b8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:43.374585 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d7ecda4f-93fa-46ea-9bb1-d1409120d8b8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:43.449568 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d7ecda4f-93fa-46ea-9bb1-d1409120d8b8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 38207 microversion: 2.20 time: 0.089106 Nov 23 14:39:43.450484 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 598/1202] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:43 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 38207 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:43.669765 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6bed7135-3946-4e69-92a7-aa6ae592ac6c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:43.670684 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6bed7135-3946-4e69-92a7-aa6ae592ac6c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:43.678395 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6bed7135-3946-4e69-92a7-aa6ae592ac6c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:43.678841 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6bed7135-3946-4e69-92a7-aa6ae592ac6c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:43.679611 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6bed7135-3946-4e69-92a7-aa6ae592ac6c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:43.680042 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6bed7135-3946-4e69-92a7-aa6ae592ac6c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:43.743944 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6bed7135-3946-4e69-92a7-aa6ae592ac6c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 14 microversion: 2.1 time: 0.078160 Nov 23 14:39:43.744564 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 605/1203] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:43 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:39:44.462144 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7a8af869-42e7-4d93-bda3-94bec9bc2ec0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:44.463131 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7a8af869-42e7-4d93-bda3-94bec9bc2ec0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:44.470170 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a8af869-42e7-4d93-bda3-94bec9bc2ec0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:44.470614 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a8af869-42e7-4d93-bda3-94bec9bc2ec0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:44.471410 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a8af869-42e7-4d93-bda3-94bec9bc2ec0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:44.471838 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a8af869-42e7-4d93-bda3-94bec9bc2ec0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:44.536977 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7a8af869-42e7-4d93-bda3-94bec9bc2ec0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 38207 microversion: 2.20 time: 0.078746 Nov 23 14:39:44.537523 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 599/1204] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:44 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 38207 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:44.755087 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-2462a7d5-0d02-4df9-9386-0ba3188fc129 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:44.756102 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-2462a7d5-0d02-4df9-9386-0ba3188fc129 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:44.762857 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2462a7d5-0d02-4df9-9386-0ba3188fc129 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:44.763301 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2462a7d5-0d02-4df9-9386-0ba3188fc129 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:44.764067 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2462a7d5-0d02-4df9-9386-0ba3188fc129 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:44.764527 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2462a7d5-0d02-4df9-9386-0ba3188fc129 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:44.822654 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-2462a7d5-0d02-4df9-9386-0ba3188fc129 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 14 microversion: 2.1 time: 0.071492 Nov 23 14:39:44.823189 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 606/1205] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:44 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:39:45.549531 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b8f7d20b-7703-4353-bc96-f85a58bf6a1e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:45.550528 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b8f7d20b-7703-4353-bc96-f85a58bf6a1e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:45.557533 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b8f7d20b-7703-4353-bc96-f85a58bf6a1e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:45.557981 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b8f7d20b-7703-4353-bc96-f85a58bf6a1e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:45.558751 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b8f7d20b-7703-4353-bc96-f85a58bf6a1e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:45.559312 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b8f7d20b-7703-4353-bc96-f85a58bf6a1e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:45.631200 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b8f7d20b-7703-4353-bc96-f85a58bf6a1e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 38207 microversion: 2.20 time: 0.085814 Nov 23 14:39:45.632140 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 600/1206] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:45 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 38207 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:45.834610 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7b55799a-e727-4105-b001-46c080ca90be tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:45.835513 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7b55799a-e727-4105-b001-46c080ca90be tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:45.842281 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7b55799a-e727-4105-b001-46c080ca90be tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:45.842718 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7b55799a-e727-4105-b001-46c080ca90be tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:45.843476 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7b55799a-e727-4105-b001-46c080ca90be tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:45.843904 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7b55799a-e727-4105-b001-46c080ca90be tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:45.903232 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7b55799a-e727-4105-b001-46c080ca90be tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 14 microversion: 2.1 time: 0.072569 Nov 23 14:39:45.904003 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 607/1207] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:45 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:39:46.643684 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-42eadbcf-7b3b-4030-9290-f4b9174584bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:46.644648 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-42eadbcf-7b3b-4030-9290-f4b9174584bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:46.651443 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-42eadbcf-7b3b-4030-9290-f4b9174584bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:46.651892 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-42eadbcf-7b3b-4030-9290-f4b9174584bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:46.652691 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-42eadbcf-7b3b-4030-9290-f4b9174584bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:46.653131 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-42eadbcf-7b3b-4030-9290-f4b9174584bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:46.731528 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-42eadbcf-7b3b-4030-9290-f4b9174584bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 38287 microversion: 2.20 time: 0.091870 Nov 23 14:39:46.732167 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 601/1208] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:46 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 38287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:46.914734 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9b38ff9e-cf2c-40d5-aa2a-232066952fe7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:46.915639 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9b38ff9e-cf2c-40d5-aa2a-232066952fe7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:46.922399 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9b38ff9e-cf2c-40d5-aa2a-232066952fe7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:46.923404 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9b38ff9e-cf2c-40d5-aa2a-232066952fe7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:46.924184 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9b38ff9e-cf2c-40d5-aa2a-232066952fe7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:46.924644 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9b38ff9e-cf2c-40d5-aa2a-232066952fe7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:47.002103 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9b38ff9e-cf2c-40d5-aa2a-232066952fe7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 9491 microversion: 2.1 time: 0.091339 Nov 23 14:39:47.002719 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 608/1209] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:46 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 9491 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:39:47.744825 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d5260819-e7ed-407d-a242-428f8fea3b04 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:47.745835 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d5260819-e7ed-407d-a242-428f8fea3b04 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:47.752942 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d5260819-e7ed-407d-a242-428f8fea3b04 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:47.753386 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d5260819-e7ed-407d-a242-428f8fea3b04 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:47.754149 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d5260819-e7ed-407d-a242-428f8fea3b04 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:47.754580 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d5260819-e7ed-407d-a242-428f8fea3b04 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:47.831871 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d5260819-e7ed-407d-a242-428f8fea3b04 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 200 len: 38348 microversion: 2.20 time: 0.090945 Nov 23 14:39:47.832900 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 602/1210] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:47 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 38348 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:39:47.842826 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e7d2383a-785f-4610-9dd4-ac9a3856baae tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:47.843407 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e7d2383a-785f-4610-9dd4-ac9a3856baae tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:47.850784 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e7d2383a-785f-4610-9dd4-ac9a3856baae tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:47.851229 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e7d2383a-785f-4610-9dd4-ac9a3856baae tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:47.852005 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e7d2383a-785f-4610-9dd4-ac9a3856baae tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:47.852464 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e7d2383a-785f-4610-9dd4-ac9a3856baae tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:47.875991 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e7d2383a-785f-4610-9dd4-ac9a3856baae tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/ips" status: 200 len: 152 microversion: 2.20 time: 0.037187 Nov 23 14:39:47.876598 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 609/1211] 10.222.0.82 () {60 vars in 1288 bytes} [Tue Nov 23 14:39:47 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:39:48.013716 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f75f079c-5024-4598-8480-0af36b75d003 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:48.014633 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f75f079c-5024-4598-8480-0af36b75d003 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:48.021438 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f75f079c-5024-4598-8480-0af36b75d003 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:48.021888 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f75f079c-5024-4598-8480-0af36b75d003 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:48.022669 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f75f079c-5024-4598-8480-0af36b75d003 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:48.023111 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f75f079c-5024-4598-8480-0af36b75d003 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:48.094350 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f75f079c-5024-4598-8480-0af36b75d003 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 16411 microversion: 2.1 time: 0.084596 Nov 23 14:39:48.095922 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 603/1212] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:48 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 16411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:39:49.106566 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ea080432-5cfb-4e9e-83ad-026ae2c8d6e8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:49.107471 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ea080432-5cfb-4e9e-83ad-026ae2c8d6e8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:49.114225 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ea080432-5cfb-4e9e-83ad-026ae2c8d6e8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:49.114668 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ea080432-5cfb-4e9e-83ad-026ae2c8d6e8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:49.115438 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ea080432-5cfb-4e9e-83ad-026ae2c8d6e8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:49.115867 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ea080432-5cfb-4e9e-83ad-026ae2c8d6e8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:49.207093 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ea080432-5cfb-4e9e-83ad-026ae2c8d6e8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 18498 microversion: 2.1 time: 0.104034 Nov 23 14:39:49.207754 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 610/1213] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:49 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 18498 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:39:50.218799 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7a5c4349-1294-4c3a-bee6-91159b77ddb1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:50.220563 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7a5c4349-1294-4c3a-bee6-91159b77ddb1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:50.227523 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a5c4349-1294-4c3a-bee6-91159b77ddb1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:50.227963 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a5c4349-1294-4c3a-bee6-91159b77ddb1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:50.228784 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a5c4349-1294-4c3a-bee6-91159b77ddb1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:50.229209 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7a5c4349-1294-4c3a-bee6-91159b77ddb1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:50.323965 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7a5c4349-1294-4c3a-bee6-91159b77ddb1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 20757 microversion: 2.1 time: 0.108999 Nov 23 14:39:50.324640 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 604/1214] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:50 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 20757 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:39:50.424295 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-092652be-e8e2-4e17-8e47-ae0734cf37b3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:50.424990 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-092652be-e8e2-4e17-8e47-ae0734cf37b3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:50.431682 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-092652be-e8e2-4e17-8e47-ae0734cf37b3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:50.432121 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-092652be-e8e2-4e17-8e47-ae0734cf37b3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:50.432908 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-092652be-e8e2-4e17-8e47-ae0734cf37b3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:50.433331 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-092652be-e8e2-4e17-8e47-ae0734cf37b3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:50.456206 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.objects.instance [None req-092652be-e8e2-4e17-8e47-ae0734cf37b3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lazy-loading 'flavor' on Instance uuid 2857aac3-a684-44f3-8205-e73b0f8505ce {{(pid=116788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:39:50.876823 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-092652be-e8e2-4e17-8e47-ae0734cf37b3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 202 len: 0 microversion: 2.20 time: 0.455634 Nov 23 14:39:50.877461 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 611/1215] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:39:50 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 14:39:50.886027 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5fb03d9a-f619-4536-aacd-5120baf655d3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:50.886727 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5fb03d9a-f619-4536-aacd-5120baf655d3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:50.894415 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5fb03d9a-f619-4536-aacd-5120baf655d3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:50.895601 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5fb03d9a-f619-4536-aacd-5120baf655d3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:50.895827 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5fb03d9a-f619-4536-aacd-5120baf655d3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:50.896291 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5fb03d9a-f619-4536-aacd-5120baf655d3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:51.027314 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5fb03d9a-f619-4536-aacd-5120baf655d3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:51.035891 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5fb03d9a-f619-4536-aacd-5120baf655d3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:51.037411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5fb03d9a-f619-4536-aacd-5120baf655d3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:51.038567 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5fb03d9a-f619-4536-aacd-5120baf655d3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.156776 Nov 23 14:39:51.039121 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 605/1216] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:39:50 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:39:51.336518 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e6670f3b-7f96-4410-83bf-d615259fcbd7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:51.337407 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e6670f3b-7f96-4410-83bf-d615259fcbd7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:51.343986 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e6670f3b-7f96-4410-83bf-d615259fcbd7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:51.344507 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e6670f3b-7f96-4410-83bf-d615259fcbd7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:51.345375 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e6670f3b-7f96-4410-83bf-d615259fcbd7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:51.345808 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e6670f3b-7f96-4410-83bf-d615259fcbd7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:51.424296 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e6670f3b-7f96-4410-83bf-d615259fcbd7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 22847 microversion: 2.1 time: 0.092359 Nov 23 14:39:51.425250 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 612/1217] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:51 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 22847 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:39:52.057852 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9aa00aae-3aeb-4014-be37-243726e62061 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:52.058452 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9aa00aae-3aeb-4014-be37-243726e62061 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:52.065290 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9aa00aae-3aeb-4014-be37-243726e62061 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:52.065731 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9aa00aae-3aeb-4014-be37-243726e62061 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:52.066496 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9aa00aae-3aeb-4014-be37-243726e62061 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:52.066929 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9aa00aae-3aeb-4014-be37-243726e62061 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:52.197082 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9aa00aae-3aeb-4014-be37-243726e62061 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:52.204756 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9aa00aae-3aeb-4014-be37-243726e62061 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:52.206255 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9aa00aae-3aeb-4014-be37-243726e62061 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:52.207421 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9aa00aae-3aeb-4014-be37-243726e62061 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.153278 Nov 23 14:39:52.207977 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 606/1218] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:39:52 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:39:52.435550 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5c4796b4-feaf-4177-83bb-06adfc6e4de5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:52.436574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5c4796b4-feaf-4177-83bb-06adfc6e4de5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:52.443398 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5c4796b4-feaf-4177-83bb-06adfc6e4de5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:52.443837 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5c4796b4-feaf-4177-83bb-06adfc6e4de5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:52.444627 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5c4796b4-feaf-4177-83bb-06adfc6e4de5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:52.445050 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5c4796b4-feaf-4177-83bb-06adfc6e4de5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:52.518377 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5c4796b4-feaf-4177-83bb-06adfc6e4de5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 23803 microversion: 2.1 time: 0.086685 Nov 23 14:39:52.518978 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 613/1219] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:52 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 23803 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:39:53.226446 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4b716b32-0791-48f9-972c-7d12a8bcfb86 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:53.227054 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4b716b32-0791-48f9-972c-7d12a8bcfb86 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:53.233405 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4b716b32-0791-48f9-972c-7d12a8bcfb86 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:53.233859 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4b716b32-0791-48f9-972c-7d12a8bcfb86 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:53.234635 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4b716b32-0791-48f9-972c-7d12a8bcfb86 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:53.235753 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4b716b32-0791-48f9-972c-7d12a8bcfb86 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:53.367497 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4b716b32-0791-48f9-972c-7d12a8bcfb86 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:53.372661 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4b716b32-0791-48f9-972c-7d12a8bcfb86 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:53.374425 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4b716b32-0791-48f9-972c-7d12a8bcfb86 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:53.375586 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4b716b32-0791-48f9-972c-7d12a8bcfb86 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.152983 Nov 23 14:39:53.376752 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 607/1220] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:39:53 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:39:53.530167 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5fb1dc8f-484b-4e7f-b8c6-737b26d40d12 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:53.531074 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5fb1dc8f-484b-4e7f-b8c6-737b26d40d12 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:53.538457 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5fb1dc8f-484b-4e7f-b8c6-737b26d40d12 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:53.538902 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5fb1dc8f-484b-4e7f-b8c6-737b26d40d12 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:53.539663 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5fb1dc8f-484b-4e7f-b8c6-737b26d40d12 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:53.540091 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5fb1dc8f-484b-4e7f-b8c6-737b26d40d12 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:53.615817 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5fb1dc8f-484b-4e7f-b8c6-737b26d40d12 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 25465 microversion: 2.1 time: 0.089634 Nov 23 14:39:53.616462 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 614/1221] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:53 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 25465 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:39:54.394324 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-177fa727-e8ad-427f-aacc-3ad15a761f11 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:54.394941 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-177fa727-e8ad-427f-aacc-3ad15a761f11 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:54.401278 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-177fa727-e8ad-427f-aacc-3ad15a761f11 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:54.401726 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-177fa727-e8ad-427f-aacc-3ad15a761f11 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:54.402505 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-177fa727-e8ad-427f-aacc-3ad15a761f11 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:54.402942 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-177fa727-e8ad-427f-aacc-3ad15a761f11 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:54.539201 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-177fa727-e8ad-427f-aacc-3ad15a761f11 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:54.546869 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-177fa727-e8ad-427f-aacc-3ad15a761f11 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:54.549046 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-177fa727-e8ad-427f-aacc-3ad15a761f11 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:54.550188 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-177fa727-e8ad-427f-aacc-3ad15a761f11 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.159728 Nov 23 14:39:54.550766 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 608/1222] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:39:54 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:39:54.628938 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-0ccd2ae0-dd3f-47f7-9040-e14c19df27da tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:54.629941 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-0ccd2ae0-dd3f-47f7-9040-e14c19df27da tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:54.636873 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0ccd2ae0-dd3f-47f7-9040-e14c19df27da tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:54.637319 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0ccd2ae0-dd3f-47f7-9040-e14c19df27da tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:54.638093 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0ccd2ae0-dd3f-47f7-9040-e14c19df27da tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:54.638532 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0ccd2ae0-dd3f-47f7-9040-e14c19df27da tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:54.714490 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-0ccd2ae0-dd3f-47f7-9040-e14c19df27da tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 26719 microversion: 2.1 time: 0.090061 Nov 23 14:39:54.715142 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 615/1223] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:54 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 26719 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:39:55.567825 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-134985e5-954e-4676-b854-c243a2e8f007 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:55.568477 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-134985e5-954e-4676-b854-c243a2e8f007 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:55.574672 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-134985e5-954e-4676-b854-c243a2e8f007 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:55.575124 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-134985e5-954e-4676-b854-c243a2e8f007 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:55.575892 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-134985e5-954e-4676-b854-c243a2e8f007 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:55.576355 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-134985e5-954e-4676-b854-c243a2e8f007 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:55.704808 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-134985e5-954e-4676-b854-c243a2e8f007 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:55.712542 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-134985e5-954e-4676-b854-c243a2e8f007 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:55.714020 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-134985e5-954e-4676-b854-c243a2e8f007 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:55.715165 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-134985e5-954e-4676-b854-c243a2e8f007 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.151313 Nov 23 14:39:55.715714 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 609/1224] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:39:55 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:39:55.726813 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6634144c-4787-46da-9559-f8c3cbe173ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:55.727824 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6634144c-4787-46da-9559-f8c3cbe173ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:55.734616 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6634144c-4787-46da-9559-f8c3cbe173ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:55.735085 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6634144c-4787-46da-9559-f8c3cbe173ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:55.735926 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6634144c-4787-46da-9559-f8c3cbe173ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:55.736393 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6634144c-4787-46da-9559-f8c3cbe173ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:55.835109 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6634144c-4787-46da-9559-f8c3cbe173ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 27411 microversion: 2.1 time: 0.112100 Nov 23 14:39:55.835771 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 616/1225] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:55 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 27411 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:39:56.733414 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4696f68c-0bc9-495d-ad0c-c58de0fd0370 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:56.734046 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4696f68c-0bc9-495d-ad0c-c58de0fd0370 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:56.740932 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4696f68c-0bc9-495d-ad0c-c58de0fd0370 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:56.741387 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4696f68c-0bc9-495d-ad0c-c58de0fd0370 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:56.742151 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4696f68c-0bc9-495d-ad0c-c58de0fd0370 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:56.742584 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4696f68c-0bc9-495d-ad0c-c58de0fd0370 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:56.847921 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-48f25970-2496-4366-8e3d-49227ebf5c4e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:56.849080 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-48f25970-2496-4366-8e3d-49227ebf5c4e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:56.855586 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-48f25970-2496-4366-8e3d-49227ebf5c4e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:56.856033 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-48f25970-2496-4366-8e3d-49227ebf5c4e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:56.856868 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-48f25970-2496-4366-8e3d-49227ebf5c4e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:56.857302 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-48f25970-2496-4366-8e3d-49227ebf5c4e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:56.871016 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4696f68c-0bc9-495d-ad0c-c58de0fd0370 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:56.879348 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4696f68c-0bc9-495d-ad0c-c58de0fd0370 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:56.880863 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4696f68c-0bc9-495d-ad0c-c58de0fd0370 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:56.882011 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4696f68c-0bc9-495d-ad0c-c58de0fd0370 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.152313 Nov 23 14:39:56.882572 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 610/1226] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:39:56 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:39:56.931586 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-48f25970-2496-4366-8e3d-49227ebf5c4e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 27821 microversion: 2.1 time: 0.088139 Nov 23 14:39:56.932506 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 617/1227] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:56 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 27821 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:39:57.900866 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-762fc18c-f9ae-4a33-814f-ff019ade2a9c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:57.901465 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-762fc18c-f9ae-4a33-814f-ff019ade2a9c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:57.907660 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-762fc18c-f9ae-4a33-814f-ff019ade2a9c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:57.908106 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-762fc18c-f9ae-4a33-814f-ff019ade2a9c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:57.908908 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-762fc18c-f9ae-4a33-814f-ff019ade2a9c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:57.909337 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-762fc18c-f9ae-4a33-814f-ff019ade2a9c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:57.944323 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-72a19b65-44cf-492d-9a1b-fd006344ca52 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:57.945321 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-72a19b65-44cf-492d-9a1b-fd006344ca52 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:57.952196 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-72a19b65-44cf-492d-9a1b-fd006344ca52 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:57.952675 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-72a19b65-44cf-492d-9a1b-fd006344ca52 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:57.953483 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-72a19b65-44cf-492d-9a1b-fd006344ca52 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:57.954462 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-72a19b65-44cf-492d-9a1b-fd006344ca52 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:58.039571 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-72a19b65-44cf-492d-9a1b-fd006344ca52 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28066 microversion: 2.1 time: 0.099009 Nov 23 14:39:58.040670 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 618/1228] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:57 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28066 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:39:58.042960 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-762fc18c-f9ae-4a33-814f-ff019ade2a9c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:58.051072 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-762fc18c-f9ae-4a33-814f-ff019ade2a9c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:58.052581 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-762fc18c-f9ae-4a33-814f-ff019ade2a9c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:58.053724 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-762fc18c-f9ae-4a33-814f-ff019ade2a9c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.156729 Nov 23 14:39:58.054273 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 611/1229] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:39:57 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:39:59.052056 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-2916af11-ae90-401f-8f82-8f89763702cc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:39:59.053084 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-2916af11-ae90-401f-8f82-8f89763702cc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:59.059831 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2916af11-ae90-401f-8f82-8f89763702cc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:59.060302 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2916af11-ae90-401f-8f82-8f89763702cc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:59.061076 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2916af11-ae90-401f-8f82-8f89763702cc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:59.061510 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2916af11-ae90-401f-8f82-8f89763702cc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:59.071838 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2450a882-c3ed-427c-8dbc-7365c4f72a4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:39:59.072550 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2450a882-c3ed-427c-8dbc-7365c4f72a4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:39:59.078702 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2450a882-c3ed-427c-8dbc-7365c4f72a4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:59.079154 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2450a882-c3ed-427c-8dbc-7365c4f72a4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:59.079940 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2450a882-c3ed-427c-8dbc-7365c4f72a4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:39:59.080422 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2450a882-c3ed-427c-8dbc-7365c4f72a4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:39:59.142190 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-2916af11-ae90-401f-8f82-8f89763702cc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28183 microversion: 2.1 time: 0.094533 Nov 23 14:39:59.142843 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 619/1230] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:39:59 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:39:59.211379 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2450a882-c3ed-427c-8dbc-7365c4f72a4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:59.218985 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2450a882-c3ed-427c-8dbc-7365c4f72a4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:59.220567 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2450a882-c3ed-427c-8dbc-7365c4f72a4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:39:59.221709 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2450a882-c3ed-427c-8dbc-7365c4f72a4b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.153725 Nov 23 14:39:59.222271 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 612/1231] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:39:59 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:00.154510 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f70bf836-cd64-402d-b9d9-a0cce92d8a8d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:00.155417 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f70bf836-cd64-402d-b9d9-a0cce92d8a8d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:00.162809 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f70bf836-cd64-402d-b9d9-a0cce92d8a8d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:00.163258 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f70bf836-cd64-402d-b9d9-a0cce92d8a8d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:00.164033 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f70bf836-cd64-402d-b9d9-a0cce92d8a8d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:00.164509 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f70bf836-cd64-402d-b9d9-a0cce92d8a8d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:00.231559 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f70bf836-cd64-402d-b9d9-a0cce92d8a8d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28183 microversion: 2.1 time: 0.081053 Nov 23 14:40:00.232175 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 620/1232] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:00 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:00.240290 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7b390824-c61b-465b-acb7-5641819edf4c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:00.240897 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7b390824-c61b-465b-acb7-5641819edf4c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:00.247062 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7b390824-c61b-465b-acb7-5641819edf4c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:00.247511 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7b390824-c61b-465b-acb7-5641819edf4c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:00.248568 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7b390824-c61b-465b-acb7-5641819edf4c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:00.248989 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7b390824-c61b-465b-acb7-5641819edf4c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:00.380746 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7b390824-c61b-465b-acb7-5641819edf4c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:00.388478 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7b390824-c61b-465b-acb7-5641819edf4c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:00.389965 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7b390824-c61b-465b-acb7-5641819edf4c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:00.391672 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7b390824-c61b-465b-acb7-5641819edf4c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.154491 Nov 23 14:40:00.392195 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 613/1233] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:00 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:01.243963 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-70a2859a-8b8d-4c34-a8bc-ff35e75d3cd1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:01.244992 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-70a2859a-8b8d-4c34-a8bc-ff35e75d3cd1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:01.253163 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-70a2859a-8b8d-4c34-a8bc-ff35e75d3cd1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:01.253611 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-70a2859a-8b8d-4c34-a8bc-ff35e75d3cd1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:01.254387 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-70a2859a-8b8d-4c34-a8bc-ff35e75d3cd1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:01.254820 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-70a2859a-8b8d-4c34-a8bc-ff35e75d3cd1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:01.366990 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-70a2859a-8b8d-4c34-a8bc-ff35e75d3cd1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28183 microversion: 2.1 time: 0.126853 Nov 23 14:40:01.367642 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 621/1234] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:01 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:01.411051 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1a947398-cdb3-4bf7-a2eb-a31c1ff1cd07 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:01.411677 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1a947398-cdb3-4bf7-a2eb-a31c1ff1cd07 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:01.418717 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1a947398-cdb3-4bf7-a2eb-a31c1ff1cd07 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:01.419299 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1a947398-cdb3-4bf7-a2eb-a31c1ff1cd07 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:01.420068 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1a947398-cdb3-4bf7-a2eb-a31c1ff1cd07 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:01.420536 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1a947398-cdb3-4bf7-a2eb-a31c1ff1cd07 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:01.561266 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-1a947398-cdb3-4bf7-a2eb-a31c1ff1cd07 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:01.569693 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-1a947398-cdb3-4bf7-a2eb-a31c1ff1cd07 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:01.574336 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-1a947398-cdb3-4bf7-a2eb-a31c1ff1cd07 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:01.574336 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1a947398-cdb3-4bf7-a2eb-a31c1ff1cd07 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.165083 Nov 23 14:40:01.574336 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 614/1235] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:01 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:02.380298 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-515c1729-9957-481f-9da2-8cb0d89bf44b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:02.381288 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-515c1729-9957-481f-9da2-8cb0d89bf44b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:02.388467 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-515c1729-9957-481f-9da2-8cb0d89bf44b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:02.388982 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-515c1729-9957-481f-9da2-8cb0d89bf44b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:02.389768 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-515c1729-9957-481f-9da2-8cb0d89bf44b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:02.390204 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-515c1729-9957-481f-9da2-8cb0d89bf44b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:02.463687 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-515c1729-9957-481f-9da2-8cb0d89bf44b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28183 microversion: 2.1 time: 0.087303 Nov 23 14:40:02.464327 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 622/1236] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:02 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:02.590649 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7f7b8b53-a105-474f-995e-16e7d637362f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:02.591165 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7f7b8b53-a105-474f-995e-16e7d637362f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:02.597390 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7f7b8b53-a105-474f-995e-16e7d637362f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:02.597839 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7f7b8b53-a105-474f-995e-16e7d637362f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:02.598612 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7f7b8b53-a105-474f-995e-16e7d637362f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:02.599048 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7f7b8b53-a105-474f-995e-16e7d637362f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:02.726218 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7f7b8b53-a105-474f-995e-16e7d637362f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:02.733745 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7f7b8b53-a105-474f-995e-16e7d637362f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:02.735904 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7f7b8b53-a105-474f-995e-16e7d637362f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:02.737074 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7f7b8b53-a105-474f-995e-16e7d637362f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.150210 Nov 23 14:40:02.737627 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 615/1237] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:02 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:03.475384 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3d1d7d29-50c2-48f0-8521-cc96ede3b7e7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:03.476408 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3d1d7d29-50c2-48f0-8521-cc96ede3b7e7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:03.483197 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3d1d7d29-50c2-48f0-8521-cc96ede3b7e7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:03.483640 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3d1d7d29-50c2-48f0-8521-cc96ede3b7e7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:03.484460 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3d1d7d29-50c2-48f0-8521-cc96ede3b7e7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:03.485008 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3d1d7d29-50c2-48f0-8521-cc96ede3b7e7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:03.543976 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3d1d7d29-50c2-48f0-8521-cc96ede3b7e7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28183 microversion: 2.1 time: 0.072479 Nov 23 14:40:03.544628 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 623/1238] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:03 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:03.755431 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-667d3cd1-0124-4f9e-ae76-ff9eaa6bab71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:03.756032 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-667d3cd1-0124-4f9e-ae76-ff9eaa6bab71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:03.763355 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-667d3cd1-0124-4f9e-ae76-ff9eaa6bab71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:03.763805 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-667d3cd1-0124-4f9e-ae76-ff9eaa6bab71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:03.764596 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-667d3cd1-0124-4f9e-ae76-ff9eaa6bab71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:03.765029 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-667d3cd1-0124-4f9e-ae76-ff9eaa6bab71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:03.896872 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-667d3cd1-0124-4f9e-ae76-ff9eaa6bab71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:03.904514 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-667d3cd1-0124-4f9e-ae76-ff9eaa6bab71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:03.905994 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-667d3cd1-0124-4f9e-ae76-ff9eaa6bab71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:03.907196 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-667d3cd1-0124-4f9e-ae76-ff9eaa6bab71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.155438 Nov 23 14:40:03.907741 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 616/1239] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:03 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:04.556721 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c6774a60-9864-47da-b6c9-3ebb0b1b7893 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:04.557653 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c6774a60-9864-47da-b6c9-3ebb0b1b7893 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:04.564521 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c6774a60-9864-47da-b6c9-3ebb0b1b7893 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:04.564961 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c6774a60-9864-47da-b6c9-3ebb0b1b7893 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:04.565719 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c6774a60-9864-47da-b6c9-3ebb0b1b7893 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:04.566156 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c6774a60-9864-47da-b6c9-3ebb0b1b7893 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:04.632431 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c6774a60-9864-47da-b6c9-3ebb0b1b7893 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28183 microversion: 2.1 time: 0.079721 Nov 23 14:40:04.633051 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 624/1240] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:04 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:04.925183 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-adf84d21-bac8-47b0-9d96-55254c7d137e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:04.925925 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-adf84d21-bac8-47b0-9d96-55254c7d137e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:04.932343 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-adf84d21-bac8-47b0-9d96-55254c7d137e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:04.932792 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-adf84d21-bac8-47b0-9d96-55254c7d137e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:04.933584 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-adf84d21-bac8-47b0-9d96-55254c7d137e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:04.934010 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-adf84d21-bac8-47b0-9d96-55254c7d137e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:05.061649 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-adf84d21-bac8-47b0-9d96-55254c7d137e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:05.069219 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-adf84d21-bac8-47b0-9d96-55254c7d137e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:05.070711 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-adf84d21-bac8-47b0-9d96-55254c7d137e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:05.071860 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-adf84d21-bac8-47b0-9d96-55254c7d137e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.150428 Nov 23 14:40:05.072452 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 617/1241] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:04 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:05.645194 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e82e22dc-2173-4b28-8e5c-a0d6c12625a5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:05.646129 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e82e22dc-2173-4b28-8e5c-a0d6c12625a5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:05.652958 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e82e22dc-2173-4b28-8e5c-a0d6c12625a5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:05.653411 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e82e22dc-2173-4b28-8e5c-a0d6c12625a5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:05.654183 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e82e22dc-2173-4b28-8e5c-a0d6c12625a5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:05.654620 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e82e22dc-2173-4b28-8e5c-a0d6c12625a5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:05.724113 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e82e22dc-2173-4b28-8e5c-a0d6c12625a5 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28183 microversion: 2.1 time: 0.083597 Nov 23 14:40:05.724769 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 625/1242] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:05 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:06.090577 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2f85624a-25f1-4f35-bbcc-550094d2e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:06.091179 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2f85624a-25f1-4f35-bbcc-550094d2e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:06.097498 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2f85624a-25f1-4f35-bbcc-550094d2e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:06.097942 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2f85624a-25f1-4f35-bbcc-550094d2e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:06.098711 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2f85624a-25f1-4f35-bbcc-550094d2e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:06.099141 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2f85624a-25f1-4f35-bbcc-550094d2e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:06.228887 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2f85624a-25f1-4f35-bbcc-550094d2e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:06.237333 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2f85624a-25f1-4f35-bbcc-550094d2e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:06.238833 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2f85624a-25f1-4f35-bbcc-550094d2e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:06.239992 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2f85624a-25f1-4f35-bbcc-550094d2e1c7 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.153100 Nov 23 14:40:06.240593 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 618/1243] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:06 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:06.736806 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f9ffc359-b685-4dfb-a866-58ca81738a5b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:06.737790 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f9ffc359-b685-4dfb-a866-58ca81738a5b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:06.744600 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f9ffc359-b685-4dfb-a866-58ca81738a5b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:06.745048 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f9ffc359-b685-4dfb-a866-58ca81738a5b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:06.745824 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f9ffc359-b685-4dfb-a866-58ca81738a5b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:06.746258 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f9ffc359-b685-4dfb-a866-58ca81738a5b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:07.137057 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f9ffc359-b685-4dfb-a866-58ca81738a5b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28183 microversion: 2.1 time: 0.404278 Nov 23 14:40:07.137867 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 626/1244] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:06 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28183 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:40:07.258294 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3c4c95fd-6de8-40d4-90ef-1b73ef2cc23d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:07.258901 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3c4c95fd-6de8-40d4-90ef-1b73ef2cc23d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:07.265063 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3c4c95fd-6de8-40d4-90ef-1b73ef2cc23d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:07.266531 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3c4c95fd-6de8-40d4-90ef-1b73ef2cc23d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:07.266995 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3c4c95fd-6de8-40d4-90ef-1b73ef2cc23d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:07.267431 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3c4c95fd-6de8-40d4-90ef-1b73ef2cc23d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:07.409474 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3c4c95fd-6de8-40d4-90ef-1b73ef2cc23d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:07.409474 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3c4c95fd-6de8-40d4-90ef-1b73ef2cc23d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:07.409771 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3c4c95fd-6de8-40d4-90ef-1b73ef2cc23d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:07.410822 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3c4c95fd-6de8-40d4-90ef-1b73ef2cc23d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.156286 Nov 23 14:40:07.411399 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 619/1245] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:07 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:08.149230 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-92d25b67-2405-4ecb-9d89-889634d10cae tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:08.150250 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-92d25b67-2405-4ecb-9d89-889634d10cae tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:08.157779 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-92d25b67-2405-4ecb-9d89-889634d10cae tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:08.158225 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-92d25b67-2405-4ecb-9d89-889634d10cae tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:08.158998 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-92d25b67-2405-4ecb-9d89-889634d10cae tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:08.159435 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-92d25b67-2405-4ecb-9d89-889634d10cae tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:08.227124 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-92d25b67-2405-4ecb-9d89-889634d10cae tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28183 microversion: 2.1 time: 0.081761 Nov 23 14:40:08.228055 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 627/1246] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:08 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:08.429297 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3342f6f8-ee2f-450d-90c6-29e3b99f1111 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:08.429840 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3342f6f8-ee2f-450d-90c6-29e3b99f1111 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:08.435987 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3342f6f8-ee2f-450d-90c6-29e3b99f1111 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:08.436478 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3342f6f8-ee2f-450d-90c6-29e3b99f1111 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:08.437250 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3342f6f8-ee2f-450d-90c6-29e3b99f1111 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:08.438450 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3342f6f8-ee2f-450d-90c6-29e3b99f1111 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:08.568251 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3342f6f8-ee2f-450d-90c6-29e3b99f1111 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:08.575785 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3342f6f8-ee2f-450d-90c6-29e3b99f1111 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:08.577293 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3342f6f8-ee2f-450d-90c6-29e3b99f1111 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:08.579014 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3342f6f8-ee2f-450d-90c6-29e3b99f1111 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1745 microversion: 2.20 time: 0.153091 Nov 23 14:40:08.579787 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 620/1247] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:08 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:09.239615 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-38760dc4-cd77-4828-b864-acba0731d84f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:09.240666 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-38760dc4-cd77-4828-b864-acba0731d84f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:09.247654 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-38760dc4-cd77-4828-b864-acba0731d84f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:09.248106 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-38760dc4-cd77-4828-b864-acba0731d84f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:09.248923 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-38760dc4-cd77-4828-b864-acba0731d84f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:09.249363 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-38760dc4-cd77-4828-b864-acba0731d84f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:09.330262 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-38760dc4-cd77-4828-b864-acba0731d84f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28183 microversion: 2.1 time: 0.094783 Nov 23 14:40:09.330911 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 628/1248] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:09 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:09.596965 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b943ddc6-b3d6-49b6-86c7-566ac20ac18d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:09.597560 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b943ddc6-b3d6-49b6-86c7-566ac20ac18d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:09.603834 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b943ddc6-b3d6-49b6-86c7-566ac20ac18d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:09.604310 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b943ddc6-b3d6-49b6-86c7-566ac20ac18d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:09.605082 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b943ddc6-b3d6-49b6-86c7-566ac20ac18d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:09.605538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b943ddc6-b3d6-49b6-86c7-566ac20ac18d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:09.732264 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-b943ddc6-b3d6-49b6-86c7-566ac20ac18d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:09.740542 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-b943ddc6-b3d6-49b6-86c7-566ac20ac18d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:09.742025 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-b943ddc6-b3d6-49b6-86c7-566ac20ac18d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:09.743168 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b943ddc6-b3d6-49b6-86c7-566ac20ac18d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1745 microversion: 2.20 time: 0.149916 Nov 23 14:40:09.743725 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 621/1249] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:09 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:10.342333 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-609c5d89-b680-42d3-ba80-f26f48800c3d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:10.343321 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-609c5d89-b680-42d3-ba80-f26f48800c3d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:10.350882 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-609c5d89-b680-42d3-ba80-f26f48800c3d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:10.351326 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-609c5d89-b680-42d3-ba80-f26f48800c3d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:10.352101 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-609c5d89-b680-42d3-ba80-f26f48800c3d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:10.352574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-609c5d89-b680-42d3-ba80-f26f48800c3d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:10.443986 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-609c5d89-b680-42d3-ba80-f26f48800c3d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28183 microversion: 2.1 time: 0.105574 Nov 23 14:40:10.444659 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 629/1250] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:10 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:10.762649 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3452f89f-f955-4809-945d-3a870f57c78e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:10.763242 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3452f89f-f955-4809-945d-3a870f57c78e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:10.770232 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3452f89f-f955-4809-945d-3a870f57c78e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:10.770677 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3452f89f-f955-4809-945d-3a870f57c78e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:10.771438 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3452f89f-f955-4809-945d-3a870f57c78e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:10.771942 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3452f89f-f955-4809-945d-3a870f57c78e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:10.901583 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3452f89f-f955-4809-945d-3a870f57c78e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:10.909830 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3452f89f-f955-4809-945d-3a870f57c78e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:10.911307 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3452f89f-f955-4809-945d-3a870f57c78e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:10.912490 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3452f89f-f955-4809-945d-3a870f57c78e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1745 microversion: 2.20 time: 0.153856 Nov 23 14:40:10.913045 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 622/1251] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:10 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:10.994297 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-9ed9cd4d-1110-4e13-ac77-0ebeed1dc4bd req-c8151f5a-a92d-4caa-b86d-1d54a418d5cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2857aac3-a684-44f3-8205-e73b0f8505ce", "name": "network-vif-plugged", "status": "completed", "tag": "34eaa672-bc07-44f3-9bb4-56d1e4fcbcbd"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:10.998324 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:40:10.998324 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:40:11.004843 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-9ed9cd4d-1110-4e13-ac77-0ebeed1dc4bd req-c8151f5a-a92d-4caa-b86d-1d54a418d5cb service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:11.005300 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-9ed9cd4d-1110-4e13-ac77-0ebeed1dc4bd req-c8151f5a-a92d-4caa-b86d-1d54a418d5cb service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:11.021133 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-9ed9cd4d-1110-4e13-ac77-0ebeed1dc4bd req-c8151f5a-a92d-4caa-b86d-1d54a418d5cb service nova] Creating event network-vif-plugged:34eaa672-bc07-44f3-9bb4-56d1e4fcbcbd for instance 2857aac3-a684-44f3-8205-e73b0f8505ce on hv-cinder-80475 Nov 23 14:40:11.021311 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-9ed9cd4d-1110-4e13-ac77-0ebeed1dc4bd req-c8151f5a-a92d-4caa-b86d-1d54a418d5cb service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030885 Nov 23 14:40:11.021812 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 630/1252] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:40:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:40:11.456184 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a963edeb-8e72-411b-9e1f-5b9771b7203c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:11.457107 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a963edeb-8e72-411b-9e1f-5b9771b7203c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:11.462853 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a963edeb-8e72-411b-9e1f-5b9771b7203c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:11.463296 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a963edeb-8e72-411b-9e1f-5b9771b7203c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:11.464064 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a963edeb-8e72-411b-9e1f-5b9771b7203c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:11.464523 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a963edeb-8e72-411b-9e1f-5b9771b7203c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:11.523586 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a963edeb-8e72-411b-9e1f-5b9771b7203c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28183 microversion: 2.1 time: 0.071734 Nov 23 14:40:11.524278 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 623/1253] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:11 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:11.931215 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-155ca763-a570-4c7d-8aa7-cae161ee27c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:11.931893 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-155ca763-a570-4c7d-8aa7-cae161ee27c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:11.938291 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-155ca763-a570-4c7d-8aa7-cae161ee27c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:11.938732 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-155ca763-a570-4c7d-8aa7-cae161ee27c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:11.940147 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-155ca763-a570-4c7d-8aa7-cae161ee27c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:11.940628 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-155ca763-a570-4c7d-8aa7-cae161ee27c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:12.068213 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-155ca763-a570-4c7d-8aa7-cae161ee27c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:12.075983 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-155ca763-a570-4c7d-8aa7-cae161ee27c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:12.077504 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-155ca763-a570-4c7d-8aa7-cae161ee27c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:12.078646 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-155ca763-a570-4c7d-8aa7-cae161ee27c5 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1745 microversion: 2.20 time: 0.151479 Nov 23 14:40:12.079213 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 631/1254] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:11 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:12.536096 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e8e1149a-b4f8-4e2c-abfa-ec4c8f256900 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:12.537028 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e8e1149a-b4f8-4e2c-abfa-ec4c8f256900 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:12.543712 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e8e1149a-b4f8-4e2c-abfa-ec4c8f256900 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:12.544154 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e8e1149a-b4f8-4e2c-abfa-ec4c8f256900 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:12.544944 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e8e1149a-b4f8-4e2c-abfa-ec4c8f256900 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:12.545376 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e8e1149a-b4f8-4e2c-abfa-ec4c8f256900 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:12.604081 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e8e1149a-b4f8-4e2c-abfa-ec4c8f256900 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28183 microversion: 2.1 time: 0.072550 Nov 23 14:40:12.604826 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 624/1255] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:12 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:13.097581 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-34fcbf1b-577a-4ff9-a808-f765a7adb5b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:13.098184 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-34fcbf1b-577a-4ff9-a808-f765a7adb5b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:13.104525 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-34fcbf1b-577a-4ff9-a808-f765a7adb5b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:13.104973 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-34fcbf1b-577a-4ff9-a808-f765a7adb5b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:13.105745 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-34fcbf1b-577a-4ff9-a808-f765a7adb5b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:13.106210 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-34fcbf1b-577a-4ff9-a808-f765a7adb5b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:13.237205 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-34fcbf1b-577a-4ff9-a808-f765a7adb5b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:13.244921 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-34fcbf1b-577a-4ff9-a808-f765a7adb5b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:13.246399 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-34fcbf1b-577a-4ff9-a808-f765a7adb5b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:13.247808 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-34fcbf1b-577a-4ff9-a808-f765a7adb5b1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1745 microversion: 2.20 time: 0.154501 Nov 23 14:40:13.248395 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 632/1256] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:13 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:13.616223 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-803e5b77-9cb6-4d63-b1c7-91f1094205f3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:13.617248 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-803e5b77-9cb6-4d63-b1c7-91f1094205f3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:13.624381 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-803e5b77-9cb6-4d63-b1c7-91f1094205f3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:13.624781 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-803e5b77-9cb6-4d63-b1c7-91f1094205f3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:13.625558 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-803e5b77-9cb6-4d63-b1c7-91f1094205f3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:13.625997 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-803e5b77-9cb6-4d63-b1c7-91f1094205f3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:13.689056 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-803e5b77-9cb6-4d63-b1c7-91f1094205f3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28183 microversion: 2.1 time: 0.076519 Nov 23 14:40:13.689750 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 625/1257] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:13 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:14.273929 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6dc835eb-fdde-4c75-8071-11278385d684 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:14.274747 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6dc835eb-fdde-4c75-8071-11278385d684 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:14.281819 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6dc835eb-fdde-4c75-8071-11278385d684 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:14.282353 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6dc835eb-fdde-4c75-8071-11278385d684 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:14.284845 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6dc835eb-fdde-4c75-8071-11278385d684 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:14.285469 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6dc835eb-fdde-4c75-8071-11278385d684 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:14.494356 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6dc835eb-fdde-4c75-8071-11278385d684 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:14.503997 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6dc835eb-fdde-4c75-8071-11278385d684 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:14.505501 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6dc835eb-fdde-4c75-8071-11278385d684 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:14.507201 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6dc835eb-fdde-4c75-8071-11278385d684 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1740 microversion: 2.20 time: 0.244319 Nov 23 14:40:14.508023 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 633/1258] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:14 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:14.701047 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-dfa33433-f3aa-47b7-b47c-d22d84154090 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:14.702687 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-dfa33433-f3aa-47b7-b47c-d22d84154090 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:14.711013 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dfa33433-f3aa-47b7-b47c-d22d84154090 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:14.713195 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dfa33433-f3aa-47b7-b47c-d22d84154090 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:14.714483 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dfa33433-f3aa-47b7-b47c-d22d84154090 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:14.714928 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dfa33433-f3aa-47b7-b47c-d22d84154090 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:14.802564 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-dfa33433-f3aa-47b7-b47c-d22d84154090 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28474 microversion: 2.1 time: 0.105196 Nov 23 14:40:14.803141 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 626/1259] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:14 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28474 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:15.526586 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3e410e3d-21e9-4593-bcf9-51a0c01f24bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:15.527249 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3e410e3d-21e9-4593-bcf9-51a0c01f24bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:15.535204 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3e410e3d-21e9-4593-bcf9-51a0c01f24bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:15.535651 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3e410e3d-21e9-4593-bcf9-51a0c01f24bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:15.536472 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3e410e3d-21e9-4593-bcf9-51a0c01f24bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:15.536907 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3e410e3d-21e9-4593-bcf9-51a0c01f24bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:15.716710 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-3e410e3d-21e9-4593-bcf9-51a0c01f24bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:15.726406 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-3e410e3d-21e9-4593-bcf9-51a0c01f24bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:15.727887 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-3e410e3d-21e9-4593-bcf9-51a0c01f24bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:15.729134 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3e410e3d-21e9-4593-bcf9-51a0c01f24bb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1740 microversion: 2.20 time: 0.206321 Nov 23 14:40:15.729878 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 634/1260] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:15 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:15.820336 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3d903d70-3122-491f-a659-b02e223a7cb4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:15.821425 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3d903d70-3122-491f-a659-b02e223a7cb4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:15.830855 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3d903d70-3122-491f-a659-b02e223a7cb4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:15.831310 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3d903d70-3122-491f-a659-b02e223a7cb4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:15.832142 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3d903d70-3122-491f-a659-b02e223a7cb4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:15.832795 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-3d903d70-3122-491f-a659-b02e223a7cb4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:15.904301 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3d903d70-3122-491f-a659-b02e223a7cb4 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28474 microversion: 2.1 time: 0.086724 Nov 23 14:40:15.904933 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 627/1261] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:15 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28474 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:16.797931 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6273325f-b89c-4702-99e8-2b3f39768c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:16.797931 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6273325f-b89c-4702-99e8-2b3f39768c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:16.797931 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6273325f-b89c-4702-99e8-2b3f39768c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:16.797931 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6273325f-b89c-4702-99e8-2b3f39768c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:16.799271 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6273325f-b89c-4702-99e8-2b3f39768c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:16.799271 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6273325f-b89c-4702-99e8-2b3f39768c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:16.898528 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6273325f-b89c-4702-99e8-2b3f39768c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:16.906320 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6273325f-b89c-4702-99e8-2b3f39768c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:16.907799 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6273325f-b89c-4702-99e8-2b3f39768c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:16.908970 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6273325f-b89c-4702-99e8-2b3f39768c16 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1740 microversion: 2.20 time: 0.166023 Nov 23 14:40:16.909527 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 635/1262] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:16 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:16.917331 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1d02d402-0397-4d82-9a0d-d67ce3396308 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:16.918551 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1d02d402-0397-4d82-9a0d-d67ce3396308 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:16.925783 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1d02d402-0397-4d82-9a0d-d67ce3396308 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:16.926258 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1d02d402-0397-4d82-9a0d-d67ce3396308 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:16.927368 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1d02d402-0397-4d82-9a0d-d67ce3396308 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:16.927814 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1d02d402-0397-4d82-9a0d-d67ce3396308 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:17.012933 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1d02d402-0397-4d82-9a0d-d67ce3396308 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.099875 Nov 23 14:40:17.016825 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 628/1263] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:16 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:17.930011 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-30083428-38b9-42d3-8469-c50e8dc2b18c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:17.931887 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-30083428-38b9-42d3-8469-c50e8dc2b18c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:17.946769 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-30083428-38b9-42d3-8469-c50e8dc2b18c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:17.948133 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-30083428-38b9-42d3-8469-c50e8dc2b18c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:17.949281 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-30083428-38b9-42d3-8469-c50e8dc2b18c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:17.949801 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-30083428-38b9-42d3-8469-c50e8dc2b18c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:18.036639 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a774d4de-8729-4064-928f-814015dda3c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:18.037663 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a774d4de-8729-4064-928f-814015dda3c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:18.054234 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a774d4de-8729-4064-928f-814015dda3c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:18.054947 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a774d4de-8729-4064-928f-814015dda3c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:18.055765 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a774d4de-8729-4064-928f-814015dda3c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:18.056212 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a774d4de-8729-4064-928f-814015dda3c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:18.128873 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-30083428-38b9-42d3-8469-c50e8dc2b18c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:18.135496 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a774d4de-8729-4064-928f-814015dda3c2 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.114128 Nov 23 14:40:18.139494 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 629/1264] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:18 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:18.142986 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-30083428-38b9-42d3-8469-c50e8dc2b18c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:18.144524 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-30083428-38b9-42d3-8469-c50e8dc2b18c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:18.145679 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-30083428-38b9-42d3-8469-c50e8dc2b18c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1740 microversion: 2.20 time: 0.222446 Nov 23 14:40:18.157749 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 636/1265] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:17 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1740 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:19.147414 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7d278d28-3445-4b4b-b4cf-58a4e747fa4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:19.148689 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7d278d28-3445-4b4b-b4cf-58a4e747fa4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:19.155622 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7d278d28-3445-4b4b-b4cf-58a4e747fa4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:19.156085 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7d278d28-3445-4b4b-b4cf-58a4e747fa4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:19.156908 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7d278d28-3445-4b4b-b4cf-58a4e747fa4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:19.158276 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7d278d28-3445-4b4b-b4cf-58a4e747fa4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:19.164649 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e898318d-718d-424d-9e46-e94ae61ce0f3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:19.165336 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e898318d-718d-424d-9e46-e94ae61ce0f3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:19.171694 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e898318d-718d-424d-9e46-e94ae61ce0f3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:19.172295 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e898318d-718d-424d-9e46-e94ae61ce0f3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:19.173576 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e898318d-718d-424d-9e46-e94ae61ce0f3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:19.174234 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e898318d-718d-424d-9e46-e94ae61ce0f3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:19.228001 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7d278d28-3445-4b4b-b4cf-58a4e747fa4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.084370 Nov 23 14:40:19.234302 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 630/1266] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:19 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:19.346533 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e898318d-718d-424d-9e46-e94ae61ce0f3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:19.355625 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e898318d-718d-424d-9e46-e94ae61ce0f3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:19.357309 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e898318d-718d-424d-9e46-e94ae61ce0f3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:19.358636 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e898318d-718d-424d-9e46-e94ae61ce0f3 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1740 microversion: 2.20 time: 0.198197 Nov 23 14:40:19.359195 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 637/1267] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:19 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:20.240876 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-68d3fc94-c0c5-4593-bf2a-3f3a1cec6d43 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:20.241867 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-68d3fc94-c0c5-4593-bf2a-3f3a1cec6d43 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:20.248938 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-68d3fc94-c0c5-4593-bf2a-3f3a1cec6d43 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:20.249387 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-68d3fc94-c0c5-4593-bf2a-3f3a1cec6d43 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:20.250163 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-68d3fc94-c0c5-4593-bf2a-3f3a1cec6d43 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:20.250597 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-68d3fc94-c0c5-4593-bf2a-3f3a1cec6d43 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:20.314529 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-68d3fc94-c0c5-4593-bf2a-3f3a1cec6d43 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.076354 Nov 23 14:40:20.314635 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 631/1268] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:20 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:20.379809 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-efb861a8-4c6d-4140-aba9-f6b00d0dd0d4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:20.381339 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-efb861a8-4c6d-4140-aba9-f6b00d0dd0d4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:20.388350 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-efb861a8-4c6d-4140-aba9-f6b00d0dd0d4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:20.388787 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-efb861a8-4c6d-4140-aba9-f6b00d0dd0d4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:20.389570 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-efb861a8-4c6d-4140-aba9-f6b00d0dd0d4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:20.389999 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-efb861a8-4c6d-4140-aba9-f6b00d0dd0d4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:20.533234 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-efb861a8-4c6d-4140-aba9-f6b00d0dd0d4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:20.542854 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-efb861a8-4c6d-4140-aba9-f6b00d0dd0d4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:20.544606 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-efb861a8-4c6d-4140-aba9-f6b00d0dd0d4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:20.545762 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-efb861a8-4c6d-4140-aba9-f6b00d0dd0d4 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1740 microversion: 2.20 time: 0.172386 Nov 23 14:40:20.546616 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 638/1269] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:20 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:21.326430 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5cc95cb5-3b81-42e2-a329-7c93f4030e6e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:21.328279 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5cc95cb5-3b81-42e2-a329-7c93f4030e6e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:21.336018 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5cc95cb5-3b81-42e2-a329-7c93f4030e6e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:21.336831 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5cc95cb5-3b81-42e2-a329-7c93f4030e6e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:21.337694 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5cc95cb5-3b81-42e2-a329-7c93f4030e6e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:21.338363 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5cc95cb5-3b81-42e2-a329-7c93f4030e6e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:21.405734 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5cc95cb5-3b81-42e2-a329-7c93f4030e6e tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.082114 Nov 23 14:40:21.407608 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 632/1270] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:21 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:21.566726 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6391a942-426d-417b-9ade-32caddcabf2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:21.567319 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6391a942-426d-417b-9ade-32caddcabf2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:21.576735 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6391a942-426d-417b-9ade-32caddcabf2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:21.577102 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6391a942-426d-417b-9ade-32caddcabf2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:21.577888 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6391a942-426d-417b-9ade-32caddcabf2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:21.578317 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6391a942-426d-417b-9ade-32caddcabf2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:21.734404 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6391a942-426d-417b-9ade-32caddcabf2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:21.744216 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6391a942-426d-417b-9ade-32caddcabf2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:21.746092 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6391a942-426d-417b-9ade-32caddcabf2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:21.747535 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6391a942-426d-417b-9ade-32caddcabf2a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1740 microversion: 2.20 time: 0.187091 Nov 23 14:40:21.748272 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 639/1271] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:21 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:22.417444 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-738f1cf8-aad6-47d4-8bc3-f3ef96efd585 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:22.419184 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-738f1cf8-aad6-47d4-8bc3-f3ef96efd585 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:22.426966 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-738f1cf8-aad6-47d4-8bc3-f3ef96efd585 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:22.427532 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-738f1cf8-aad6-47d4-8bc3-f3ef96efd585 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:22.428422 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-738f1cf8-aad6-47d4-8bc3-f3ef96efd585 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:22.428926 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-738f1cf8-aad6-47d4-8bc3-f3ef96efd585 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:22.497628 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-738f1cf8-aad6-47d4-8bc3-f3ef96efd585 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.080331 Nov 23 14:40:22.498529 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 633/1272] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:22 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:22.769725 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c5be7d7c-2515-467c-a793-b8daa1219996 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:22.770307 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c5be7d7c-2515-467c-a793-b8daa1219996 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:22.776572 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c5be7d7c-2515-467c-a793-b8daa1219996 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:22.777024 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c5be7d7c-2515-467c-a793-b8daa1219996 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:22.777799 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c5be7d7c-2515-467c-a793-b8daa1219996 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:22.778228 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c5be7d7c-2515-467c-a793-b8daa1219996 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:22.928821 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c5be7d7c-2515-467c-a793-b8daa1219996 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:22.937626 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c5be7d7c-2515-467c-a793-b8daa1219996 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:22.940674 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c5be7d7c-2515-467c-a793-b8daa1219996 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:22.941911 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c5be7d7c-2515-467c-a793-b8daa1219996 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1740 microversion: 2.20 time: 0.177377 Nov 23 14:40:22.942496 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 640/1273] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:22 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:23.510107 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f184d2b4-f5fe-4539-a4c2-fac399d3350b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:23.511098 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f184d2b4-f5fe-4539-a4c2-fac399d3350b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:23.518648 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f184d2b4-f5fe-4539-a4c2-fac399d3350b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:23.519100 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f184d2b4-f5fe-4539-a4c2-fac399d3350b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:23.519875 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f184d2b4-f5fe-4539-a4c2-fac399d3350b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:23.520333 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f184d2b4-f5fe-4539-a4c2-fac399d3350b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:23.591558 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f184d2b4-f5fe-4539-a4c2-fac399d3350b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.088243 Nov 23 14:40:23.592377 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 634/1274] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:23 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:23.961068 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d6f2d4e2-08fd-43f2-811e-2fa97e9282b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:23.962320 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d6f2d4e2-08fd-43f2-811e-2fa97e9282b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:23.968624 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d6f2d4e2-08fd-43f2-811e-2fa97e9282b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:23.969072 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d6f2d4e2-08fd-43f2-811e-2fa97e9282b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:23.970501 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d6f2d4e2-08fd-43f2-811e-2fa97e9282b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:23.970930 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d6f2d4e2-08fd-43f2-811e-2fa97e9282b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:24.114045 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d6f2d4e2-08fd-43f2-811e-2fa97e9282b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:24.122182 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d6f2d4e2-08fd-43f2-811e-2fa97e9282b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:24.123658 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d6f2d4e2-08fd-43f2-811e-2fa97e9282b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:24.124823 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d6f2d4e2-08fd-43f2-811e-2fa97e9282b2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1740 microversion: 2.20 time: 0.167502 Nov 23 14:40:24.125394 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 641/1275] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:23 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:24.604745 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4ac62901-4c36-4d92-9389-202c4f4e1162 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:24.605736 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4ac62901-4c36-4d92-9389-202c4f4e1162 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:24.613305 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4ac62901-4c36-4d92-9389-202c4f4e1162 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:24.613754 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4ac62901-4c36-4d92-9389-202c4f4e1162 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:24.614528 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4ac62901-4c36-4d92-9389-202c4f4e1162 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:24.614966 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4ac62901-4c36-4d92-9389-202c4f4e1162 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:24.725514 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4ac62901-4c36-4d92-9389-202c4f4e1162 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.124610 Nov 23 14:40:24.726183 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 635/1276] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:24 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:25.142720 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d520e401-c5bb-4d47-89d4-fb8f39d7fe40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:25.143312 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d520e401-c5bb-4d47-89d4-fb8f39d7fe40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:25.149714 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d520e401-c5bb-4d47-89d4-fb8f39d7fe40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:25.150160 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d520e401-c5bb-4d47-89d4-fb8f39d7fe40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:25.150926 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d520e401-c5bb-4d47-89d4-fb8f39d7fe40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:25.151353 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d520e401-c5bb-4d47-89d4-fb8f39d7fe40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:25.285033 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d520e401-c5bb-4d47-89d4-fb8f39d7fe40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:25.292755 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d520e401-c5bb-4d47-89d4-fb8f39d7fe40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:25.294223 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d520e401-c5bb-4d47-89d4-fb8f39d7fe40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:25.295357 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d520e401-c5bb-4d47-89d4-fb8f39d7fe40 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1740 microversion: 2.20 time: 0.156441 Nov 23 14:40:25.295916 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 642/1277] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:25 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:25.737512 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2aa19951-6deb-4796-ad95-3ec482a512fb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:25.738524 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2aa19951-6deb-4796-ad95-3ec482a512fb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:25.746759 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2aa19951-6deb-4796-ad95-3ec482a512fb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:25.747210 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2aa19951-6deb-4796-ad95-3ec482a512fb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:25.747986 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2aa19951-6deb-4796-ad95-3ec482a512fb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:25.748457 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2aa19951-6deb-4796-ad95-3ec482a512fb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:25.837458 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2aa19951-6deb-4796-ad95-3ec482a512fb tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.103804 Nov 23 14:40:25.841420 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 636/1278] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:25 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:26.314489 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d6eaf72e-e128-445a-a2a7-600f3cb80fb0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:26.315094 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d6eaf72e-e128-445a-a2a7-600f3cb80fb0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:26.321428 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d6eaf72e-e128-445a-a2a7-600f3cb80fb0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:26.321874 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d6eaf72e-e128-445a-a2a7-600f3cb80fb0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:26.322651 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d6eaf72e-e128-445a-a2a7-600f3cb80fb0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:26.323080 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d6eaf72e-e128-445a-a2a7-600f3cb80fb0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:26.452609 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d6eaf72e-e128-445a-a2a7-600f3cb80fb0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:26.460264 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d6eaf72e-e128-445a-a2a7-600f3cb80fb0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:26.461786 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d6eaf72e-e128-445a-a2a7-600f3cb80fb0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:26.462930 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d6eaf72e-e128-445a-a2a7-600f3cb80fb0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1722 microversion: 2.20 time: 0.152852 Nov 23 14:40:26.463515 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 643/1279] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:26 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:26.849161 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a70c9e53-3440-4076-8092-025fd2d7ae23 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:26.850179 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a70c9e53-3440-4076-8092-025fd2d7ae23 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:26.856957 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a70c9e53-3440-4076-8092-025fd2d7ae23 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:26.857399 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a70c9e53-3440-4076-8092-025fd2d7ae23 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:26.858168 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a70c9e53-3440-4076-8092-025fd2d7ae23 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:26.858600 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a70c9e53-3440-4076-8092-025fd2d7ae23 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:26.928764 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a70c9e53-3440-4076-8092-025fd2d7ae23 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.083381 Nov 23 14:40:26.938818 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 637/1280] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:26 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:27.481749 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-8147f8b7-1faf-46d4-84eb-fafb5819f36a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:27.482352 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-8147f8b7-1faf-46d4-84eb-fafb5819f36a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:27.489237 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8147f8b7-1faf-46d4-84eb-fafb5819f36a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:27.489682 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8147f8b7-1faf-46d4-84eb-fafb5819f36a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:27.490453 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8147f8b7-1faf-46d4-84eb-fafb5819f36a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:27.491072 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8147f8b7-1faf-46d4-84eb-fafb5819f36a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:27.623514 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-8147f8b7-1faf-46d4-84eb-fafb5819f36a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:27.631311 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-8147f8b7-1faf-46d4-84eb-fafb5819f36a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:27.632869 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-8147f8b7-1faf-46d4-84eb-fafb5819f36a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:27.634069 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-8147f8b7-1faf-46d4-84eb-fafb5819f36a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1722 microversion: 2.20 time: 0.155929 Nov 23 14:40:27.634618 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 644/1281] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:27 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:27.942190 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-88f40d85-92b1-4ca2-b319-5dded62fc4b6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:27.943206 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-88f40d85-92b1-4ca2-b319-5dded62fc4b6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:27.950263 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-88f40d85-92b1-4ca2-b319-5dded62fc4b6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:27.950707 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-88f40d85-92b1-4ca2-b319-5dded62fc4b6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:27.951491 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-88f40d85-92b1-4ca2-b319-5dded62fc4b6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:27.951927 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-88f40d85-92b1-4ca2-b319-5dded62fc4b6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:28.014218 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-88f40d85-92b1-4ca2-b319-5dded62fc4b6 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.077347 Nov 23 14:40:28.014865 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 638/1282] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:27 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:28.653227 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1a207bc5-fb97-4c11-9689-5f05999f4a71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:28.653783 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1a207bc5-fb97-4c11-9689-5f05999f4a71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:28.661028 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1a207bc5-fb97-4c11-9689-5f05999f4a71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:28.661625 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1a207bc5-fb97-4c11-9689-5f05999f4a71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:28.662388 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1a207bc5-fb97-4c11-9689-5f05999f4a71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:28.662818 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1a207bc5-fb97-4c11-9689-5f05999f4a71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:28.793514 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1a207bc5-fb97-4c11-9689-5f05999f4a71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:28.801989 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1a207bc5-fb97-4c11-9689-5f05999f4a71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:28.803457 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1a207bc5-fb97-4c11-9689-5f05999f4a71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:28.804712 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1a207bc5-fb97-4c11-9689-5f05999f4a71 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1665 microversion: 2.20 time: 0.155222 Nov 23 14:40:28.805263 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 645/1283] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:28 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:28.822986 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6605cee6-1254-436e-9c3e-436ac79b2d00 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdb5baa7-bb00-4da4-8291-53ebf0d23c9d"}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:28.824128 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6605cee6-1254-436e-9c3e-436ac79b2d00 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:28.831241 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6605cee6-1254-436e-9c3e-436ac79b2d00 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:28.831692 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6605cee6-1254-436e-9c3e-436ac79b2d00 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:28.832521 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6605cee6-1254-436e-9c3e-436ac79b2d00 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:28.832980 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6605cee6-1254-436e-9c3e-436ac79b2d00 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:29.018404 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-637782a4-1f19-4663-97b1-9ab7aa90e05f req-f0a2cbc6-d1a8-44de-aca2-079f437414a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2857aac3-a684-44f3-8205-e73b0f8505ce", "name": "network-vif-unplugged", "status": "completed", "tag": "34eaa672-bc07-44f3-9bb4-56d1e4fcbcbd"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:29.020347 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:40:29.020347 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:40:29.029690 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-637782a4-1f19-4663-97b1-9ab7aa90e05f req-f0a2cbc6-d1a8-44de-aca2-079f437414a9 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:29.029983 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-637782a4-1f19-4663-97b1-9ab7aa90e05f req-f0a2cbc6-d1a8-44de-aca2-079f437414a9 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:29.042510 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.compute.server_external_events [req-637782a4-1f19-4663-97b1-9ab7aa90e05f req-f0a2cbc6-d1a8-44de-aca2-079f437414a9 service nova] Unable to find a host for instance 2857aac3-a684-44f3-8205-e73b0f8505ce. Dropping event network-vif-unplugged {{(pid=116788) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 23 14:40:29.043401 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-637782a4-1f19-4663-97b1-9ab7aa90e05f req-f0a2cbc6-d1a8-44de-aca2-079f437414a9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029526 Nov 23 14:40:29.043963 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 646/1284] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:40:29 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 23 14:40:29.049048 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5a79fb27-c3ac-42c2-8cd5-b565235954be tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:29.049926 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5a79fb27-c3ac-42c2-8cd5-b565235954be tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:29.055400 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5a79fb27-c3ac-42c2-8cd5-b565235954be tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:29.055846 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5a79fb27-c3ac-42c2-8cd5-b565235954be tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:29.056642 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5a79fb27-c3ac-42c2-8cd5-b565235954be tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:29.057080 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5a79fb27-c3ac-42c2-8cd5-b565235954be tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:29.122681 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5a79fb27-c3ac-42c2-8cd5-b565235954be tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.077369 Nov 23 14:40:29.124199 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 647/1285] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:29 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:29.244650 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7a9744f5-9f36-4c13-9093-a785f8f13b33 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-770874200"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:29.245301 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7a9744f5-9f36-4c13-9093-a785f8f13b33 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:29.252862 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7a9744f5-9f36-4c13-9093-a785f8f13b33 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:29.253304 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7a9744f5-9f36-4c13-9093-a785f8f13b33 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:29.254080 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7a9744f5-9f36-4c13-9093-a785f8f13b33 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:29.254508 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7a9744f5-9f36-4c13-9093-a785f8f13b33 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:29.403725 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.network.security_group_api [None req-7a9744f5-9f36-4c13-9093-a785f8f13b33 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Removing security group 7f0a13f9-2db1-41e4-a272-ab01fe473a9f from port 18ae7b24-5975-46e7-908e-8cbd192f6d2f Nov 23 14:40:29.727490 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6605cee6-1254-436e-9c3e-436ac79b2d00 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.908647 Nov 23 14:40:29.728312 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 639/1286] 10.222.0.82 () {62 vars in 1363 bytes} [Tue Nov 23 14:40:28 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/os-volume_attachments => generated 188 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:29.826767 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7a9744f5-9f36-4c13-9093-a785f8f13b33 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "POST /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/action" status: 202 len: 0 microversion: 2.1 time: 0.586685 Nov 23 14:40:29.828342 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 648/1287] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:29 2021] POST /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:40:29.837251 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-f35a45e5-13b2-4325-8a49-3d770fc13882 req-e15d13cd-041d-440c-8053-f817c7e2b98c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f30691a4-e578-4658-afcf-033a9a8ef9fe", "tag": "18ae7b24-5975-46e7-908e-8cbd192f6d2f"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:29.844327 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:40:29.844327 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:40:29.854799 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-f35a45e5-13b2-4325-8a49-3d770fc13882 req-e15d13cd-041d-440c-8053-f817c7e2b98c service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:29.855253 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-f35a45e5-13b2-4325-8a49-3d770fc13882 req-e15d13cd-041d-440c-8053-f817c7e2b98c service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:29.886900 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-f35a45e5-13b2-4325-8a49-3d770fc13882 req-e15d13cd-041d-440c-8053-f817c7e2b98c service nova] Creating event network-changed:18ae7b24-5975-46e7-908e-8cbd192f6d2f for instance f30691a4-e578-4658-afcf-033a9a8ef9fe on hv-cinder-80475 Nov 23 14:40:29.894560 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-f35a45e5-13b2-4325-8a49-3d770fc13882 req-e15d13cd-041d-440c-8053-f817c7e2b98c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060633 Nov 23 14:40:29.900138 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bf2cc86f-c8c9-4ed8-a524-5a5de596678f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:29.901430 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bf2cc86f-c8c9-4ed8-a524-5a5de596678f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:29.919770 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 640/1288] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:40:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:40:29.921732 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bf2cc86f-c8c9-4ed8-a524-5a5de596678f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:29.922905 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bf2cc86f-c8c9-4ed8-a524-5a5de596678f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:29.924048 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bf2cc86f-c8c9-4ed8-a524-5a5de596678f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:29.925032 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bf2cc86f-c8c9-4ed8-a524-5a5de596678f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:30.136009 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f2015aaa-ce64-44ac-ba0f-2bbe93824d4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:30.137437 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f2015aaa-ce64-44ac-ba0f-2bbe93824d4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:30.144726 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f2015aaa-ce64-44ac-ba0f-2bbe93824d4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:30.145525 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f2015aaa-ce64-44ac-ba0f-2bbe93824d4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:30.146544 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f2015aaa-ce64-44ac-ba0f-2bbe93824d4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:30.147214 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f2015aaa-ce64-44ac-ba0f-2bbe93824d4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:30.272561 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f2015aaa-ce64-44ac-ba0f-2bbe93824d4f tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.140265 Nov 23 14:40:30.273212 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 641/1289] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:30 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:40:30.607572 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bf2cc86f-c8c9-4ed8-a524-5a5de596678f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "DELETE /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/os-volume_attachments/fdb5baa7-bb00-4da4-8291-53ebf0d23c9d" status: 202 len: 0 microversion: 2.20 time: 0.711010 Nov 23 14:40:30.608087 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 649/1290] 10.222.0.82 () {60 vars in 1456 bytes} [Tue Nov 23 14:40:29 2021] DELETE /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/os-volume_attachments/fdb5baa7-bb00-4da4-8291-53ebf0d23c9d => generated 0 bytes in 712 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 23 14:40:30.667291 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c45c5703-dfdc-498b-997a-2b181d059b66 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:30.668215 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c45c5703-dfdc-498b-997a-2b181d059b66 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:30.675068 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c45c5703-dfdc-498b-997a-2b181d059b66 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:30.676248 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c45c5703-dfdc-498b-997a-2b181d059b66 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:30.677378 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c45c5703-dfdc-498b-997a-2b181d059b66 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:30.677979 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c45c5703-dfdc-498b-997a-2b181d059b66 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:30.881169 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c45c5703-dfdc-498b-997a-2b181d059b66 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action" status: 202 len: 0 microversion: 2.20 time: 0.217599 Nov 23 14:40:30.882699 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 642/1291] 10.222.0.82 () {62 vars in 1318 bytes} [Tue Nov 23 14:40:30 2021] POST /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 14:40:30.892939 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-8421b4cd-4c87-4dcd-8c08-3f03361b13da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:30.893806 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-8421b4cd-4c87-4dcd-8c08-3f03361b13da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:30.907576 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8421b4cd-4c87-4dcd-8c08-3f03361b13da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:30.909876 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8421b4cd-4c87-4dcd-8c08-3f03361b13da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:30.910965 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8421b4cd-4c87-4dcd-8c08-3f03361b13da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:30.913058 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-8421b4cd-4c87-4dcd-8c08-3f03361b13da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:31.286252 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-97fbaaf5-af09-4fca-b173-bac500ff8960 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:31.287351 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-97fbaaf5-af09-4fca-b173-bac500ff8960 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:31.298532 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-97fbaaf5-af09-4fca-b173-bac500ff8960 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:31.299293 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-97fbaaf5-af09-4fca-b173-bac500ff8960 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:31.301129 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-97fbaaf5-af09-4fca-b173-bac500ff8960 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:31.302589 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-97fbaaf5-af09-4fca-b173-bac500ff8960 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:31.380548 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-97fbaaf5-af09-4fca-b173-bac500ff8960 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.098695 Nov 23 14:40:31.381378 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 643/1292] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:31 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:31.444164 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-8421b4cd-4c87-4dcd-8c08-3f03361b13da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:31.452405 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-8421b4cd-4c87-4dcd-8c08-3f03361b13da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:31.454083 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-8421b4cd-4c87-4dcd-8c08-3f03361b13da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:31.455366 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-8421b4cd-4c87-4dcd-8c08-3f03361b13da tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1673 microversion: 2.20 time: 0.568631 Nov 23 14:40:31.456166 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 650/1293] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:30 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1673 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:31.562151 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-24fb5dee-fb07-4ab3-8a04-83bbe43fab92 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:31.563596 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-24fb5dee-fb07-4ab3-8a04-83bbe43fab92 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:31.572147 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-354c8a5d-d26f-45d9-abf2-54f906d978cc req-0b9c4e3c-ce01-4c79-8566-14673f779761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d82b41-cf80-4881-975e-eb1d71b0efc7", "tag": "20c986d1-94ea-44c7-9233-9b2ae752b164"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:31.573601 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-24fb5dee-fb07-4ab3-8a04-83bbe43fab92 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:31.574053 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-24fb5dee-fb07-4ab3-8a04-83bbe43fab92 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:31.574193 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:40:31.574193 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:40:31.574836 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-24fb5dee-fb07-4ab3-8a04-83bbe43fab92 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:31.575269 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-24fb5dee-fb07-4ab3-8a04-83bbe43fab92 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:31.585016 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-354c8a5d-d26f-45d9-abf2-54f906d978cc req-0b9c4e3c-ce01-4c79-8566-14673f779761 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:31.590393 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-354c8a5d-d26f-45d9-abf2-54f906d978cc req-0b9c4e3c-ce01-4c79-8566-14673f779761 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:31.624020 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-354c8a5d-d26f-45d9-abf2-54f906d978cc req-0b9c4e3c-ce01-4c79-8566-14673f779761 service nova] Creating event network-changed:20c986d1-94ea-44c7-9233-9b2ae752b164 for instance 09d82b41-cf80-4881-975e-eb1d71b0efc7 on hv-cinder-80475 Nov 23 14:40:31.630251 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-354c8a5d-d26f-45d9-abf2-54f906d978cc req-0b9c4e3c-ce01-4c79-8566-14673f779761 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061647 Nov 23 14:40:31.630855 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 651/1294] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:40:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:40:31.676557 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-24fb5dee-fb07-4ab3-8a04-83bbe43fab92 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Going to try to terminate instance {{(pid=116787) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:40:31.722221 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-809c2830-737a-4aa0-94ec-d1e26250a572 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:31.723001 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-809c2830-737a-4aa0-94ec-d1e26250a572 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:31.732661 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-809c2830-737a-4aa0-94ec-d1e26250a572 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:31.733104 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-809c2830-737a-4aa0-94ec-d1e26250a572 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:31.733918 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-809c2830-737a-4aa0-94ec-d1e26250a572 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:31.734354 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-809c2830-737a-4aa0-94ec-d1e26250a572 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:31.905278 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.objects.instance [None req-809c2830-737a-4aa0-94ec-d1e26250a572 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lazy-loading 'services' on Instance uuid f30691a4-e578-4658-afcf-033a9a8ef9fe {{(pid=116788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:40:32.049025 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-24fb5dee-fb07-4ab3-8a04-83bbe43fab92 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "DELETE /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 204 len: 0 microversion: 2.1 time: 0.489688 Nov 23 14:40:32.050086 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 644/1295] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:40:31 2021] DELETE /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 14:40:32.057732 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-106ee2d2-7815-4e34-bbff-50141bf4801d req-236cb2eb-8833-44f0-bcc4-fd352c6750c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f30691a4-e578-4658-afcf-033a9a8ef9fe", "tag": "18ae7b24-5975-46e7-908e-8cbd192f6d2f"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:32.057732 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:40:32.057732 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:40:32.072957 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-106ee2d2-7815-4e34-bbff-50141bf4801d req-236cb2eb-8833-44f0-bcc4-fd352c6750c8 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:32.073412 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-106ee2d2-7815-4e34-bbff-50141bf4801d req-236cb2eb-8833-44f0-bcc4-fd352c6750c8 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:32.093199 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-106ee2d2-7815-4e34-bbff-50141bf4801d req-236cb2eb-8833-44f0-bcc4-fd352c6750c8 service nova] Creating event network-changed:18ae7b24-5975-46e7-908e-8cbd192f6d2f for instance f30691a4-e578-4658-afcf-033a9a8ef9fe on hv-cinder-80475 Nov 23 14:40:32.101679 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-106ee2d2-7815-4e34-bbff-50141bf4801d req-236cb2eb-8833-44f0-bcc4-fd352c6750c8 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049655 Nov 23 14:40:32.102444 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 645/1296] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:40:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:40:32.108994 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8bd9d44d-8b21-43db-8c42-403c606e38af tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:32.109910 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8bd9d44d-8b21-43db-8c42-403c606e38af tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:32.118254 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8bd9d44d-8b21-43db-8c42-403c606e38af tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:32.119662 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8bd9d44d-8b21-43db-8c42-403c606e38af tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:32.119662 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8bd9d44d-8b21-43db-8c42-403c606e38af tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:32.120169 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8bd9d44d-8b21-43db-8c42-403c606e38af tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:32.175329 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-809c2830-737a-4aa0-94ec-d1e26250a572 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "DELETE /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/os-volume_attachments/4556a7e1-1742-4fbd-a5f2-c0beb0f9ee9b" status: 202 len: 0 microversion: 2.1 time: 0.458623 Nov 23 14:40:32.179381 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 652/1297] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Nov 23 14:40:31 2021] DELETE /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/os-volume_attachments/4556a7e1-1742-4fbd-a5f2-c0beb0f9ee9b => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:40:32.189229 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1f366d4b-caad-4323-a9a6-76c2c7d6d1f8 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:32.193326 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1f366d4b-caad-4323-a9a6-76c2c7d6d1f8 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:32.202556 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1f366d4b-caad-4323-a9a6-76c2c7d6d1f8 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:32.203008 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1f366d4b-caad-4323-a9a6-76c2c7d6d1f8 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:32.205658 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1f366d4b-caad-4323-a9a6-76c2c7d6d1f8 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:32.205658 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1f366d4b-caad-4323-a9a6-76c2c7d6d1f8 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:32.247673 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1f366d4b-caad-4323-a9a6-76c2c7d6d1f8 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066102 Nov 23 14:40:32.248661 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 653/1298] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:40:32 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:40:32.401867 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-25d21ff7-7a02-4c8b-81e6-1717c59cd746 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:32.403192 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-25d21ff7-7a02-4c8b-81e6-1717c59cd746 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:32.430705 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-25d21ff7-7a02-4c8b-81e6-1717c59cd746 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:32.431631 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-25d21ff7-7a02-4c8b-81e6-1717c59cd746 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:32.442530 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-25d21ff7-7a02-4c8b-81e6-1717c59cd746 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:32.442639 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-8bd9d44d-8b21-43db-8c42-403c606e38af tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:32.442751 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-25d21ff7-7a02-4c8b-81e6-1717c59cd746 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:32.456744 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8bd9d44d-8b21-43db-8c42-403c606e38af tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1569 microversion: 2.1 time: 0.345066 Nov 23 14:40:32.457408 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 646/1299] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:32 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1569 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:40:32.551456 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-25d21ff7-7a02-4c8b-81e6-1717c59cd746 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.160462 Nov 23 14:40:32.552492 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 654/1300] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:32 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:32.639592 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-15527d3a-2453-4266-bd07-a026d6f6ec3f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:32.640461 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-15527d3a-2453-4266-bd07-a026d6f6ec3f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:32.648616 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-15527d3a-2453-4266-bd07-a026d6f6ec3f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:32.653725 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-15527d3a-2453-4266-bd07-a026d6f6ec3f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:32.655054 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-15527d3a-2453-4266-bd07-a026d6f6ec3f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:32.655507 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-15527d3a-2453-4266-bd07-a026d6f6ec3f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:32.884963 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-15527d3a-2453-4266-bd07-a026d6f6ec3f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:32.893972 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-15527d3a-2453-4266-bd07-a026d6f6ec3f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:32.895933 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-15527d3a-2453-4266-bd07-a026d6f6ec3f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:32.906231 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-15527d3a-2453-4266-bd07-a026d6f6ec3f tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1675 microversion: 2.20 time: 0.433999 Nov 23 14:40:32.914943 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 647/1301] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:32 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1675 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:33.261484 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-611c4246-28d3-45b7-aacb-ce015d3d7f62 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:33.262542 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-611c4246-28d3-45b7-aacb-ce015d3d7f62 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:33.271751 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-611c4246-28d3-45b7-aacb-ce015d3d7f62 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:33.272200 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-611c4246-28d3-45b7-aacb-ce015d3d7f62 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:33.273585 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-611c4246-28d3-45b7-aacb-ce015d3d7f62 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:33.274028 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-611c4246-28d3-45b7-aacb-ce015d3d7f62 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:33.308298 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-611c4246-28d3-45b7-aacb-ce015d3d7f62 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051012 Nov 23 14:40:33.308874 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 655/1302] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:40:33 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:40:33.473691 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-475311b3-7d4a-48e4-83d8-1b63af30d3d2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:33.474450 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-475311b3-7d4a-48e4-83d8-1b63af30d3d2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:33.480402 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-475311b3-7d4a-48e4-83d8-1b63af30d3d2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:33.480933 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-475311b3-7d4a-48e4-83d8-1b63af30d3d2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:33.481773 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-475311b3-7d4a-48e4-83d8-1b63af30d3d2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:33.482295 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-475311b3-7d4a-48e4-83d8-1b63af30d3d2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:33.648948 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a0631755-b969-4d6b-91ef-4c454afade16 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:33.649859 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a0631755-b969-4d6b-91ef-4c454afade16 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:33.655287 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-475311b3-7d4a-48e4-83d8-1b63af30d3d2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:33.660175 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a0631755-b969-4d6b-91ef-4c454afade16 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:33.660664 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a0631755-b969-4d6b-91ef-4c454afade16 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:33.661532 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a0631755-b969-4d6b-91ef-4c454afade16 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:33.661914 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a0631755-b969-4d6b-91ef-4c454afade16 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:33.663023 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-475311b3-7d4a-48e4-83d8-1b63af30d3d2 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1450 microversion: 2.1 time: 0.192969 Nov 23 14:40:33.664471 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 648/1303] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:33 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1450 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:40:33.774357 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a0631755-b969-4d6b-91ef-4c454afade16 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.214850 Nov 23 14:40:33.774932 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 656/1304] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:33 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:40:33.927695 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-cb097381-52a9-4d92-88a8-1803bce50082 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:33.928387 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-cb097381-52a9-4d92-88a8-1803bce50082 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:33.934698 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cb097381-52a9-4d92-88a8-1803bce50082 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:33.935149 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cb097381-52a9-4d92-88a8-1803bce50082 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:33.935924 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cb097381-52a9-4d92-88a8-1803bce50082 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:33.936403 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cb097381-52a9-4d92-88a8-1803bce50082 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:34.154787 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-cb097381-52a9-4d92-88a8-1803bce50082 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:34.163339 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-cb097381-52a9-4d92-88a8-1803bce50082 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:34.164875 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-cb097381-52a9-4d92-88a8-1803bce50082 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:34.166285 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-cb097381-52a9-4d92-88a8-1803bce50082 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.242125 Nov 23 14:40:34.166927 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 649/1305] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:33 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:34.320409 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7150feea-8163-481f-a149-92fa2528d868 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:34.321438 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7150feea-8163-481f-a149-92fa2528d868 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:34.328456 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7150feea-8163-481f-a149-92fa2528d868 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:34.328905 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7150feea-8163-481f-a149-92fa2528d868 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:34.329675 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7150feea-8163-481f-a149-92fa2528d868 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:34.330108 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7150feea-8163-481f-a149-92fa2528d868 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:34.358602 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7150feea-8163-481f-a149-92fa2528d868 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042625 Nov 23 14:40:34.359972 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 657/1306] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:40:34 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:40:34.373239 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d0d7d53b-4ed2-400f-a882-4e8fc469f62d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:34.373862 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d0d7d53b-4ed2-400f-a882-4e8fc469f62d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:34.381306 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d0d7d53b-4ed2-400f-a882-4e8fc469f62d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:34.381879 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d0d7d53b-4ed2-400f-a882-4e8fc469f62d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:34.382777 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d0d7d53b-4ed2-400f-a882-4e8fc469f62d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:34.383635 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d0d7d53b-4ed2-400f-a882-4e8fc469f62d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:34.475920 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-d0d7d53b-4ed2-400f-a882-4e8fc469f62d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] HTTP exception thrown: Instance f30691a4-e578-4658-afcf-033a9a8ef9fe is not attached to volume 4556a7e1-1742-4fbd-a5f2-c0beb0f9ee9b Nov 23 14:40:34.478131 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d0d7d53b-4ed2-400f-a882-4e8fc469f62d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Returning 404 to user: Instance f30691a4-e578-4658-afcf-033a9a8ef9fe is not attached to volume 4556a7e1-1742-4fbd-a5f2-c0beb0f9ee9b {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:40:34.479381 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d0d7d53b-4ed2-400f-a882-4e8fc469f62d tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "DELETE /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/os-volume_attachments/4556a7e1-1742-4fbd-a5f2-c0beb0f9ee9b" status: 404 len: 154 microversion: 2.1 time: 0.111706 Nov 23 14:40:34.480139 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 650/1307] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Nov 23 14:40:34 2021] DELETE /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe/os-volume_attachments/4556a7e1-1742-4fbd-a5f2-c0beb0f9ee9b => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:40:34.639691 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-699d9652-319f-4941-b64d-ed1c6e00e694 req-7c9c9243-f6e2-4aeb-a1be-6ba119a906f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d82b41-cf80-4881-975e-eb1d71b0efc7", "name": "network-vif-deleted", "tag": "20c986d1-94ea-44c7-9233-9b2ae752b164"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:34.642032 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:40:34.642032 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:40:34.651574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-699d9652-319f-4941-b64d-ed1c6e00e694 req-7c9c9243-f6e2-4aeb-a1be-6ba119a906f3 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:34.652297 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-699d9652-319f-4941-b64d-ed1c6e00e694 req-7c9c9243-f6e2-4aeb-a1be-6ba119a906f3 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:34.665738 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-699d9652-319f-4941-b64d-ed1c6e00e694 req-7c9c9243-f6e2-4aeb-a1be-6ba119a906f3 service nova] Creating event network-vif-deleted:20c986d1-94ea-44c7-9233-9b2ae752b164 for instance 09d82b41-cf80-4881-975e-eb1d71b0efc7 on hv-cinder-80475 Nov 23 14:40:34.671332 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-699d9652-319f-4941-b64d-ed1c6e00e694 req-7c9c9243-f6e2-4aeb-a1be-6ba119a906f3 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035358 Nov 23 14:40:34.672725 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 658/1308] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:40:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:40:34.683211 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-11b57cc1-bc20-4146-adac-4590d574d6e5 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:34.683845 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-11b57cc1-bc20-4146-adac-4590d574d6e5 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:34.695223 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-11b57cc1-bc20-4146-adac-4590d574d6e5 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:34.695678 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-11b57cc1-bc20-4146-adac-4590d574d6e5 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:34.696546 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-11b57cc1-bc20-4146-adac-4590d574d6e5 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:34.697001 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-11b57cc1-bc20-4146-adac-4590d574d6e5 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:34.773084 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-11b57cc1-bc20-4146-adac-4590d574d6e5 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:34.787490 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e0b4c391-bb6b-4db2-be1d-81d9a9e3f3f7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:34.789321 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e0b4c391-bb6b-4db2-be1d-81d9a9e3f3f7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:34.790361 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-11b57cc1-bc20-4146-adac-4590d574d6e5 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1382 microversion: 2.1 time: 0.112484 Nov 23 14:40:34.791039 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 651/1309] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:34 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1382 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:40:34.797881 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e0b4c391-bb6b-4db2-be1d-81d9a9e3f3f7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:34.798842 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e0b4c391-bb6b-4db2-be1d-81d9a9e3f3f7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:34.800199 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e0b4c391-bb6b-4db2-be1d-81d9a9e3f3f7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:34.800942 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e0b4c391-bb6b-4db2-be1d-81d9a9e3f3f7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:35.184368 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f71ca252-053d-4955-b674-f55768624fa9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:35.184929 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f71ca252-053d-4955-b674-f55768624fa9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:35.191521 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f71ca252-053d-4955-b674-f55768624fa9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:35.191975 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f71ca252-053d-4955-b674-f55768624fa9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:35.192784 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f71ca252-053d-4955-b674-f55768624fa9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:35.193228 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f71ca252-053d-4955-b674-f55768624fa9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:35.339292 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f71ca252-053d-4955-b674-f55768624fa9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:35.348826 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f71ca252-053d-4955-b674-f55768624fa9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:35.350536 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f71ca252-053d-4955-b674-f55768624fa9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:35.351712 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f71ca252-053d-4955-b674-f55768624fa9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.171179 Nov 23 14:40:35.352273 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 652/1310] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:35 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:35.766078 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-31816793-debf-42ab-8c68-a30fb4ae3d50 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:35.766748 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-31816793-debf-42ab-8c68-a30fb4ae3d50 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:35.773115 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-31816793-debf-42ab-8c68-a30fb4ae3d50 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:35.773597 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-31816793-debf-42ab-8c68-a30fb4ae3d50 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:35.774392 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-31816793-debf-42ab-8c68-a30fb4ae3d50 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:35.774822 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-31816793-debf-42ab-8c68-a30fb4ae3d50 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:35.799409 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-31816793-debf-42ab-8c68-a30fb4ae3d50 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Going to try to terminate instance {{(pid=116787) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:40:36.059082 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-31816793-debf-42ab-8c68-a30fb4ae3d50 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "DELETE /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 204 len: 0 microversion: 2.1 time: 0.296395 Nov 23 14:40:36.059594 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 653/1311] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:40:35 2021] DELETE /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 14:40:36.065325 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-03ae36e5-dc6a-4223-aa1d-c8a5b5ae6ec4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:36.066023 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-03ae36e5-dc6a-4223-aa1d-c8a5b5ae6ec4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:36.072333 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-03ae36e5-dc6a-4223-aa1d-c8a5b5ae6ec4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:36.072773 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-03ae36e5-dc6a-4223-aa1d-c8a5b5ae6ec4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:36.073610 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-03ae36e5-dc6a-4223-aa1d-c8a5b5ae6ec4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:36.074054 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-03ae36e5-dc6a-4223-aa1d-c8a5b5ae6ec4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:36.148606 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-03ae36e5-dc6a-4223-aa1d-c8a5b5ae6ec4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:36.156013 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-03ae36e5-dc6a-4223-aa1d-c8a5b5ae6ec4 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1382 microversion: 2.1 time: 0.095292 Nov 23 14:40:36.157593 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 654/1312] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:36 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1382 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:40:36.161762 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-bc3a0aa6-b20b-404f-a639-22b190931ded tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:36.162360 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-bc3a0aa6-b20b-404f-a639-22b190931ded tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:36.167695 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bc3a0aa6-b20b-404f-a639-22b190931ded tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:36.168142 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bc3a0aa6-b20b-404f-a639-22b190931ded tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:36.168951 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bc3a0aa6-b20b-404f-a639-22b190931ded tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:36.169389 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-bc3a0aa6-b20b-404f-a639-22b190931ded tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:36.317517 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-bc3a0aa6-b20b-404f-a639-22b190931ded tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:36.326064 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-bc3a0aa6-b20b-404f-a639-22b190931ded tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1554 microversion: 2.1 time: 0.167454 Nov 23 14:40:36.326663 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 655/1313] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:36 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:40:36.374240 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0411296b-5393-40cf-99b0-7264f290f0ab tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:36.375367 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0411296b-5393-40cf-99b0-7264f290f0ab tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:36.382531 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0411296b-5393-40cf-99b0-7264f290f0ab tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:36.383152 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0411296b-5393-40cf-99b0-7264f290f0ab tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:36.385411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0411296b-5393-40cf-99b0-7264f290f0ab tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:36.385926 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0411296b-5393-40cf-99b0-7264f290f0ab tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:36.549129 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0411296b-5393-40cf-99b0-7264f290f0ab tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:36.549461 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0411296b-5393-40cf-99b0-7264f290f0ab tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:36.551018 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0411296b-5393-40cf-99b0-7264f290f0ab tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:36.552220 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0411296b-5393-40cf-99b0-7264f290f0ab tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.182473 Nov 23 14:40:36.553036 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 656/1314] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:36 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:37.174066 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c25a476b-ecc1-4078-827e-7244c34d8359 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:37.174672 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c25a476b-ecc1-4078-827e-7244c34d8359 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:37.180498 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c25a476b-ecc1-4078-827e-7244c34d8359 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:37.180942 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c25a476b-ecc1-4078-827e-7244c34d8359 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:37.181704 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c25a476b-ecc1-4078-827e-7244c34d8359 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:37.182134 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c25a476b-ecc1-4078-827e-7244c34d8359 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:37.243524 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c25a476b-ecc1-4078-827e-7244c34d8359 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:37.251774 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c25a476b-ecc1-4078-827e-7244c34d8359 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1382 microversion: 2.1 time: 0.081620 Nov 23 14:40:37.252358 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 657/1315] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:37 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1382 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:37.342690 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-293e9eb9-8dd0-4ac5-8e51-e71cff9e5308 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:37.343295 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-293e9eb9-8dd0-4ac5-8e51-e71cff9e5308 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:37.349553 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-293e9eb9-8dd0-4ac5-8e51-e71cff9e5308 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:37.349997 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-293e9eb9-8dd0-4ac5-8e51-e71cff9e5308 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:37.350770 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-293e9eb9-8dd0-4ac5-8e51-e71cff9e5308 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:37.351198 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-293e9eb9-8dd0-4ac5-8e51-e71cff9e5308 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:37.489692 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-293e9eb9-8dd0-4ac5-8e51-e71cff9e5308 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:37.497686 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-293e9eb9-8dd0-4ac5-8e51-e71cff9e5308 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1554 microversion: 2.1 time: 0.158628 Nov 23 14:40:37.498440 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 658/1316] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:37 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:37.570790 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-fea5f120-c49d-471e-aaa0-26a9bbe8e68d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:37.571420 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-fea5f120-c49d-471e-aaa0-26a9bbe8e68d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:37.577380 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fea5f120-c49d-471e-aaa0-26a9bbe8e68d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:37.578527 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fea5f120-c49d-471e-aaa0-26a9bbe8e68d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:37.579591 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fea5f120-c49d-471e-aaa0-26a9bbe8e68d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:37.580118 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fea5f120-c49d-471e-aaa0-26a9bbe8e68d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:37.716715 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-fea5f120-c49d-471e-aaa0-26a9bbe8e68d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:37.725555 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-fea5f120-c49d-471e-aaa0-26a9bbe8e68d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:37.727083 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-fea5f120-c49d-471e-aaa0-26a9bbe8e68d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:37.728269 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-fea5f120-c49d-471e-aaa0-26a9bbe8e68d tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.161310 Nov 23 14:40:37.728827 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 659/1317] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:37 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:38.273279 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e69793d1-10e1-4d68-940f-47c3100c32f7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:38.276982 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e69793d1-10e1-4d68-940f-47c3100c32f7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:38.286469 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e69793d1-10e1-4d68-940f-47c3100c32f7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:38.292009 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e69793d1-10e1-4d68-940f-47c3100c32f7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:38.292009 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e69793d1-10e1-4d68-940f-47c3100c32f7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:38.292009 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e69793d1-10e1-4d68-940f-47c3100c32f7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:38.349910 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e69793d1-10e1-4d68-940f-47c3100c32f7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:38.357792 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e69793d1-10e1-4d68-940f-47c3100c32f7 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1382 microversion: 2.1 time: 0.092910 Nov 23 14:40:38.359901 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 660/1318] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:38 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1382 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:38.514724 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5e12b9a2-947e-4a27-a155-c9a3441fe033 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:38.515329 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5e12b9a2-947e-4a27-a155-c9a3441fe033 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:38.522185 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5e12b9a2-947e-4a27-a155-c9a3441fe033 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:38.522629 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5e12b9a2-947e-4a27-a155-c9a3441fe033 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:38.523393 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5e12b9a2-947e-4a27-a155-c9a3441fe033 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:38.523819 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5e12b9a2-947e-4a27-a155-c9a3441fe033 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:38.662689 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5e12b9a2-947e-4a27-a155-c9a3441fe033 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:38.670933 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5e12b9a2-947e-4a27-a155-c9a3441fe033 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1554 microversion: 2.1 time: 0.159743 Nov 23 14:40:38.671524 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 661/1319] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:38 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:40:38.747262 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0cf2e88e-7396-40ab-85ca-b8fed14015fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:38.747978 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0cf2e88e-7396-40ab-85ca-b8fed14015fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:38.764900 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0cf2e88e-7396-40ab-85ca-b8fed14015fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:38.765443 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0cf2e88e-7396-40ab-85ca-b8fed14015fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:38.766390 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0cf2e88e-7396-40ab-85ca-b8fed14015fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:38.766826 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0cf2e88e-7396-40ab-85ca-b8fed14015fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:38.908750 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0cf2e88e-7396-40ab-85ca-b8fed14015fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:38.916779 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0cf2e88e-7396-40ab-85ca-b8fed14015fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:38.918336 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0cf2e88e-7396-40ab-85ca-b8fed14015fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:38.919554 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0cf2e88e-7396-40ab-85ca-b8fed14015fe tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.176314 Nov 23 14:40:38.920301 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 662/1320] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:38 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:39.377606 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-89cbd494-4e9d-4c20-b119-05cb15e44790 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:39.378476 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-89cbd494-4e9d-4c20-b119-05cb15e44790 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:39.387699 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-89cbd494-4e9d-4c20-b119-05cb15e44790 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:39.388214 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-89cbd494-4e9d-4c20-b119-05cb15e44790 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:39.389211 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-89cbd494-4e9d-4c20-b119-05cb15e44790 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:39.389649 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-89cbd494-4e9d-4c20-b119-05cb15e44790 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:39.453871 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-89cbd494-4e9d-4c20-b119-05cb15e44790 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:39.461736 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-89cbd494-4e9d-4c20-b119-05cb15e44790 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1382 microversion: 2.1 time: 0.089477 Nov 23 14:40:39.462326 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 663/1321] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:39 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1382 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:39.689044 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ec266fc9-1c90-4205-9136-366f89e465da tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:39.689666 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ec266fc9-1c90-4205-9136-366f89e465da tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:39.695591 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ec266fc9-1c90-4205-9136-366f89e465da tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:39.696042 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ec266fc9-1c90-4205-9136-366f89e465da tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:39.696849 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ec266fc9-1c90-4205-9136-366f89e465da tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:39.697281 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ec266fc9-1c90-4205-9136-366f89e465da tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:39.838307 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-ec266fc9-1c90-4205-9136-366f89e465da tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:39.846579 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ec266fc9-1c90-4205-9136-366f89e465da tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1554 microversion: 2.1 time: 0.161598 Nov 23 14:40:39.852481 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 664/1322] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:39 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:39.939394 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1b80c9d9-58bc-4dc6-a4e9-75bd174447ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:39.939914 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1b80c9d9-58bc-4dc6-a4e9-75bd174447ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:39.945935 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1b80c9d9-58bc-4dc6-a4e9-75bd174447ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:39.946386 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1b80c9d9-58bc-4dc6-a4e9-75bd174447ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:39.947168 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1b80c9d9-58bc-4dc6-a4e9-75bd174447ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:39.947604 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1b80c9d9-58bc-4dc6-a4e9-75bd174447ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:40.090206 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-1b80c9d9-58bc-4dc6-a4e9-75bd174447ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:40.098803 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-1b80c9d9-58bc-4dc6-a4e9-75bd174447ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:40.100306 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-1b80c9d9-58bc-4dc6-a4e9-75bd174447ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:40.101487 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1b80c9d9-58bc-4dc6-a4e9-75bd174447ff tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.166529 Nov 23 14:40:40.102247 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 665/1323] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:39 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:40.480147 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f4145280-ce48-474e-aad9-20093043492e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:40.481749 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f4145280-ce48-474e-aad9-20093043492e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:40.489363 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f4145280-ce48-474e-aad9-20093043492e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:40.489909 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f4145280-ce48-474e-aad9-20093043492e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:40.490662 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f4145280-ce48-474e-aad9-20093043492e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:40.491175 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f4145280-ce48-474e-aad9-20093043492e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:40.550810 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f4145280-ce48-474e-aad9-20093043492e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:40.558151 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f4145280-ce48-474e-aad9-20093043492e tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1382 microversion: 2.1 time: 0.082728 Nov 23 14:40:40.558928 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 666/1324] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:40 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1382 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:40.863627 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1767eaae-d870-408c-a36a-a95f77eb6590 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:40.864143 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1767eaae-d870-408c-a36a-a95f77eb6590 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:40.871053 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1767eaae-d870-408c-a36a-a95f77eb6590 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:40.871590 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1767eaae-d870-408c-a36a-a95f77eb6590 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:40.872549 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1767eaae-d870-408c-a36a-a95f77eb6590 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:40.873141 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1767eaae-d870-408c-a36a-a95f77eb6590 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:41.012456 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-1767eaae-d870-408c-a36a-a95f77eb6590 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:41.021735 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1767eaae-d870-408c-a36a-a95f77eb6590 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1554 microversion: 2.1 time: 0.162540 Nov 23 14:40:41.022600 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 667/1325] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:40 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:41.119038 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0a390e22-a348-42df-9de8-5612341c95d2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:41.119610 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0a390e22-a348-42df-9de8-5612341c95d2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:41.133101 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0a390e22-a348-42df-9de8-5612341c95d2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:41.133569 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0a390e22-a348-42df-9de8-5612341c95d2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:41.134342 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0a390e22-a348-42df-9de8-5612341c95d2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:41.134779 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0a390e22-a348-42df-9de8-5612341c95d2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:41.269985 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0a390e22-a348-42df-9de8-5612341c95d2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:41.279419 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0a390e22-a348-42df-9de8-5612341c95d2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:41.285594 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0a390e22-a348-42df-9de8-5612341c95d2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:41.285594 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0a390e22-a348-42df-9de8-5612341c95d2 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.168441 Nov 23 14:40:41.285594 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 668/1326] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:41 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:41.575700 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-856c8ed0-c84c-4804-99fe-76707b9801d8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:41.576485 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-856c8ed0-c84c-4804-99fe-76707b9801d8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:41.583742 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-856c8ed0-c84c-4804-99fe-76707b9801d8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:41.584188 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-856c8ed0-c84c-4804-99fe-76707b9801d8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:41.585115 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-856c8ed0-c84c-4804-99fe-76707b9801d8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:41.585552 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-856c8ed0-c84c-4804-99fe-76707b9801d8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:41.646633 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-856c8ed0-c84c-4804-99fe-76707b9801d8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:41.654213 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-856c8ed0-c84c-4804-99fe-76707b9801d8 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1382 microversion: 2.1 time: 0.082366 Nov 23 14:40:41.654968 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 669/1327] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:41 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1382 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:40:42.038644 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-dc9a62f8-115f-45ae-8b24-e5dc679866cb tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:42.039246 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-dc9a62f8-115f-45ae-8b24-e5dc679866cb tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:42.045099 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dc9a62f8-115f-45ae-8b24-e5dc679866cb tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:42.045537 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dc9a62f8-115f-45ae-8b24-e5dc679866cb tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:42.046297 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dc9a62f8-115f-45ae-8b24-e5dc679866cb tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:42.046726 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-dc9a62f8-115f-45ae-8b24-e5dc679866cb tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:42.187837 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-dc9a62f8-115f-45ae-8b24-e5dc679866cb tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:42.197341 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-dc9a62f8-115f-45ae-8b24-e5dc679866cb tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1554 microversion: 2.1 time: 0.162248 Nov 23 14:40:42.198087 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 670/1328] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:42 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:42.303306 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c75173cd-7c63-48b6-b90e-afb54e4bfb54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:42.303867 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c75173cd-7c63-48b6-b90e-afb54e4bfb54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:42.309775 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c75173cd-7c63-48b6-b90e-afb54e4bfb54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:42.310229 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c75173cd-7c63-48b6-b90e-afb54e4bfb54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:42.311036 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c75173cd-7c63-48b6-b90e-afb54e4bfb54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:42.311598 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c75173cd-7c63-48b6-b90e-afb54e4bfb54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:42.467703 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c75173cd-7c63-48b6-b90e-afb54e4bfb54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:42.476375 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c75173cd-7c63-48b6-b90e-afb54e4bfb54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:42.477864 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c75173cd-7c63-48b6-b90e-afb54e4bfb54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:42.479013 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c75173cd-7c63-48b6-b90e-afb54e4bfb54 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.179679 Nov 23 14:40:42.479571 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 671/1329] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:42 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:42.671012 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0fc89e3f-9e52-442d-813e-ad04899e17c9 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:42.672561 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0fc89e3f-9e52-442d-813e-ad04899e17c9 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:42.680219 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0fc89e3f-9e52-442d-813e-ad04899e17c9 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:42.692450 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0fc89e3f-9e52-442d-813e-ad04899e17c9 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:42.693459 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0fc89e3f-9e52-442d-813e-ad04899e17c9 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:42.693912 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0fc89e3f-9e52-442d-813e-ad04899e17c9 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:42.759419 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0fc89e3f-9e52-442d-813e-ad04899e17c9 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:42.769246 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0fc89e3f-9e52-442d-813e-ad04899e17c9 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1382 microversion: 2.1 time: 0.102672 Nov 23 14:40:42.769838 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 672/1330] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:42 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1382 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:43.215227 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-11108830-b2a4-4346-9cab-e62cd56646a4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:43.215885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-11108830-b2a4-4346-9cab-e62cd56646a4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:43.221833 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-11108830-b2a4-4346-9cab-e62cd56646a4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:43.222269 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-11108830-b2a4-4346-9cab-e62cd56646a4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:43.223125 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-11108830-b2a4-4346-9cab-e62cd56646a4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:43.223566 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-11108830-b2a4-4346-9cab-e62cd56646a4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:43.360548 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-11108830-b2a4-4346-9cab-e62cd56646a4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:43.371619 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-11108830-b2a4-4346-9cab-e62cd56646a4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1554 microversion: 2.1 time: 0.159940 Nov 23 14:40:43.382231 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 673/1331] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:43 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:43.499182 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-40d6fa76-6b78-40f5-962d-2b50efc3d30e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:43.499873 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-40d6fa76-6b78-40f5-962d-2b50efc3d30e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:43.506618 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-40d6fa76-6b78-40f5-962d-2b50efc3d30e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:43.507068 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-40d6fa76-6b78-40f5-962d-2b50efc3d30e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:43.507841 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-40d6fa76-6b78-40f5-962d-2b50efc3d30e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:43.508298 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-40d6fa76-6b78-40f5-962d-2b50efc3d30e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:43.650809 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-40d6fa76-6b78-40f5-962d-2b50efc3d30e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:43.670022 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-40d6fa76-6b78-40f5-962d-2b50efc3d30e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:43.671606 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-40d6fa76-6b78-40f5-962d-2b50efc3d30e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:43.672935 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-40d6fa76-6b78-40f5-962d-2b50efc3d30e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.177929 Nov 23 14:40:43.674506 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 674/1332] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:43 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:43.786578 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6a373d33-6b6f-470f-9961-d870661935b5 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:43.787095 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6a373d33-6b6f-470f-9961-d870661935b5 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:43.793399 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a373d33-6b6f-470f-9961-d870661935b5 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:43.793844 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a373d33-6b6f-470f-9961-d870661935b5 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:43.794604 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a373d33-6b6f-470f-9961-d870661935b5 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:43.795032 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a373d33-6b6f-470f-9961-d870661935b5 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:43.858591 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6a373d33-6b6f-470f-9961-d870661935b5 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:43.866771 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6a373d33-6b6f-470f-9961-d870661935b5 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1382 microversion: 2.1 time: 0.084557 Nov 23 14:40:43.867328 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 675/1333] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:43 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1382 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:44.388747 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2ce9e6d8-da9d-4b4a-bf5f-578949305558 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:44.389352 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2ce9e6d8-da9d-4b4a-bf5f-578949305558 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:44.396192 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2ce9e6d8-da9d-4b4a-bf5f-578949305558 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:44.396680 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2ce9e6d8-da9d-4b4a-bf5f-578949305558 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:44.397444 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2ce9e6d8-da9d-4b4a-bf5f-578949305558 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:44.397873 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2ce9e6d8-da9d-4b4a-bf5f-578949305558 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:44.540024 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2ce9e6d8-da9d-4b4a-bf5f-578949305558 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:44.547563 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2ce9e6d8-da9d-4b4a-bf5f-578949305558 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1554 microversion: 2.1 time: 0.162436 Nov 23 14:40:44.548131 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 676/1334] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:44 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:44.692732 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e7fa1bbc-db7c-497d-8c03-d7ac8a36dceb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:44.693418 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e7fa1bbc-db7c-497d-8c03-d7ac8a36dceb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:44.699133 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e7fa1bbc-db7c-497d-8c03-d7ac8a36dceb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:44.699572 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e7fa1bbc-db7c-497d-8c03-d7ac8a36dceb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:44.700503 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e7fa1bbc-db7c-497d-8c03-d7ac8a36dceb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:44.700940 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e7fa1bbc-db7c-497d-8c03-d7ac8a36dceb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:44.835270 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e7fa1bbc-db7c-497d-8c03-d7ac8a36dceb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:44.845385 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e7fa1bbc-db7c-497d-8c03-d7ac8a36dceb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:44.847008 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e7fa1bbc-db7c-497d-8c03-d7ac8a36dceb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:44.848339 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e7fa1bbc-db7c-497d-8c03-d7ac8a36dceb tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.159908 Nov 23 14:40:44.848896 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 677/1335] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:44 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:44.884846 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-fd74408a-ea9e-4737-812f-db2081c694df tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:44.885453 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-fd74408a-ea9e-4737-812f-db2081c694df tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:44.891379 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fd74408a-ea9e-4737-812f-db2081c694df tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:44.891828 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fd74408a-ea9e-4737-812f-db2081c694df tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:44.892633 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fd74408a-ea9e-4737-812f-db2081c694df tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:44.893095 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fd74408a-ea9e-4737-812f-db2081c694df tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:44.951640 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-fd74408a-ea9e-4737-812f-db2081c694df tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:44.959901 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-fd74408a-ea9e-4737-812f-db2081c694df tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1382 microversion: 2.1 time: 0.078530 Nov 23 14:40:44.960846 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 678/1336] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:44 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1382 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:45.564691 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-18d8aa0e-1b5c-48fa-bd65-96865edce049 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:45.566122 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-18d8aa0e-1b5c-48fa-bd65-96865edce049 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:45.572765 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-18d8aa0e-1b5c-48fa-bd65-96865edce049 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:45.577294 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-18d8aa0e-1b5c-48fa-bd65-96865edce049 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:45.577294 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-18d8aa0e-1b5c-48fa-bd65-96865edce049 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:45.577294 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-18d8aa0e-1b5c-48fa-bd65-96865edce049 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:45.716433 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-18d8aa0e-1b5c-48fa-bd65-96865edce049 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:45.723690 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-18d8aa0e-1b5c-48fa-bd65-96865edce049 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1554 microversion: 2.1 time: 0.163349 Nov 23 14:40:45.724268 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 679/1337] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:45 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:45.867171 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-77596bf0-bfc2-4bcb-a890-9d643348a976 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:45.867769 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-77596bf0-bfc2-4bcb-a890-9d643348a976 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:45.874248 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-77596bf0-bfc2-4bcb-a890-9d643348a976 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:45.874690 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-77596bf0-bfc2-4bcb-a890-9d643348a976 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:45.875453 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-77596bf0-bfc2-4bcb-a890-9d643348a976 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:45.875880 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-77596bf0-bfc2-4bcb-a890-9d643348a976 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:46.011863 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-77596bf0-bfc2-4bcb-a890-9d643348a976 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:46.020859 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-77596bf0-bfc2-4bcb-a890-9d643348a976 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:46.022433 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-77596bf0-bfc2-4bcb-a890-9d643348a976 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:46.023624 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-77596bf0-bfc2-4bcb-a890-9d643348a976 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.160151 Nov 23 14:40:46.024888 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 680/1338] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:45 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:46.029348 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6e87cd60-1d51-4d7c-9db0-cda2a08da539 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:46.030001 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6e87cd60-1d51-4d7c-9db0-cda2a08da539 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:46.037375 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6e87cd60-1d51-4d7c-9db0-cda2a08da539 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:46.037833 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6e87cd60-1d51-4d7c-9db0-cda2a08da539 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:46.038617 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6e87cd60-1d51-4d7c-9db0-cda2a08da539 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:46.039048 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6e87cd60-1d51-4d7c-9db0-cda2a08da539 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:46.100053 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6e87cd60-1d51-4d7c-9db0-cda2a08da539 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:46.107721 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6e87cd60-1d51-4d7c-9db0-cda2a08da539 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1382 microversion: 2.1 time: 0.081737 Nov 23 14:40:46.108522 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 681/1339] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:46 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1382 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:40:46.740693 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5ba831d4-8ce2-43e4-aa70-992a96c8f767 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:46.741353 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5ba831d4-8ce2-43e4-aa70-992a96c8f767 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:46.747334 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5ba831d4-8ce2-43e4-aa70-992a96c8f767 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:46.747774 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5ba831d4-8ce2-43e4-aa70-992a96c8f767 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:46.748567 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5ba831d4-8ce2-43e4-aa70-992a96c8f767 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:46.748995 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5ba831d4-8ce2-43e4-aa70-992a96c8f767 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:46.876914 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5ba831d4-8ce2-43e4-aa70-992a96c8f767 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:46.884734 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5ba831d4-8ce2-43e4-aa70-992a96c8f767 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1554 microversion: 2.1 time: 0.148466 Nov 23 14:40:46.885298 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 682/1340] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:46 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:47.041958 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a7f5953a-16f0-431a-985f-1d46e089bc39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:47.042592 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a7f5953a-16f0-431a-985f-1d46e089bc39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:47.048354 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a7f5953a-16f0-431a-985f-1d46e089bc39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:47.048802 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a7f5953a-16f0-431a-985f-1d46e089bc39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:47.049618 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a7f5953a-16f0-431a-985f-1d46e089bc39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:47.050051 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a7f5953a-16f0-431a-985f-1d46e089bc39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:47.177945 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a7f5953a-16f0-431a-985f-1d46e089bc39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:47.185579 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a7f5953a-16f0-431a-985f-1d46e089bc39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:47.187072 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a7f5953a-16f0-431a-985f-1d46e089bc39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:47.188218 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a7f5953a-16f0-431a-985f-1d46e089bc39 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.149956 Nov 23 14:40:47.188793 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 683/1341] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:47 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:47.193683 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6029e878-0205-41f6-9cb7-dac22ba68c17 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:47.194283 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6029e878-0205-41f6-9cb7-dac22ba68c17 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:47.199487 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6029e878-0205-41f6-9cb7-dac22ba68c17 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:47.199935 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6029e878-0205-41f6-9cb7-dac22ba68c17 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:47.200806 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6029e878-0205-41f6-9cb7-dac22ba68c17 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:47.201240 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6029e878-0205-41f6-9cb7-dac22ba68c17 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:47.259514 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6029e878-0205-41f6-9cb7-dac22ba68c17 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:47.266622 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6029e878-0205-41f6-9cb7-dac22ba68c17 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1382 microversion: 2.1 time: 0.076911 Nov 23 14:40:47.267182 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 684/1342] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:47 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1382 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:40:47.902274 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-68791ead-284b-42a3-ad5a-aa8747df63f4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:47.902974 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-68791ead-284b-42a3-ad5a-aa8747df63f4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:47.909691 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-68791ead-284b-42a3-ad5a-aa8747df63f4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:47.910121 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-68791ead-284b-42a3-ad5a-aa8747df63f4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:47.910885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-68791ead-284b-42a3-ad5a-aa8747df63f4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:47.911310 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-68791ead-284b-42a3-ad5a-aa8747df63f4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:48.041386 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-68791ead-284b-42a3-ad5a-aa8747df63f4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:48.048552 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-68791ead-284b-42a3-ad5a-aa8747df63f4 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1554 microversion: 2.1 time: 0.149906 Nov 23 14:40:48.049123 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 685/1343] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:47 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:48.207215 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5e458c24-3532-4bda-a6aa-a3a0bacfc96e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:48.207821 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5e458c24-3532-4bda-a6aa-a3a0bacfc96e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:48.213535 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5e458c24-3532-4bda-a6aa-a3a0bacfc96e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:48.213986 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5e458c24-3532-4bda-a6aa-a3a0bacfc96e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:48.214756 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5e458c24-3532-4bda-a6aa-a3a0bacfc96e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:48.215189 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5e458c24-3532-4bda-a6aa-a3a0bacfc96e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:48.344616 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5e458c24-3532-4bda-a6aa-a3a0bacfc96e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:48.352222 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5e458c24-3532-4bda-a6aa-a3a0bacfc96e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:48.353738 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5e458c24-3532-4bda-a6aa-a3a0bacfc96e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:48.354885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5e458c24-3532-4bda-a6aa-a3a0bacfc96e tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.152078 Nov 23 14:40:48.355438 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 686/1344] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:48 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:48.359627 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8e41eeb0-bebf-418e-a88b-b1bc54a78825 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:48.360227 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-8e41eeb0-bebf-418e-a88b-b1bc54a78825 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:48.366041 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8e41eeb0-bebf-418e-a88b-b1bc54a78825 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:48.366493 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8e41eeb0-bebf-418e-a88b-b1bc54a78825 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:48.367274 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8e41eeb0-bebf-418e-a88b-b1bc54a78825 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:48.367711 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-8e41eeb0-bebf-418e-a88b-b1bc54a78825 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:48.427385 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-8e41eeb0-bebf-418e-a88b-b1bc54a78825 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:48.434580 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8e41eeb0-bebf-418e-a88b-b1bc54a78825 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1382 microversion: 2.1 time: 0.078218 Nov 23 14:40:48.435166 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 687/1345] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:48 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1382 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:40:49.019540 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e0b4c391-bb6b-4db2-be1d-81d9a9e3f3f7 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 14.236500 Nov 23 14:40:49.020204 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 659/1346] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:34 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 14239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:40:49.066133 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e901517f-0a92-4ea2-aa9f-292bb7ad7251 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:49.066894 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e901517f-0a92-4ea2-aa9f-292bb7ad7251 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:49.073375 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e901517f-0a92-4ea2-aa9f-292bb7ad7251 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:49.073831 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e901517f-0a92-4ea2-aa9f-292bb7ad7251 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:49.074704 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e901517f-0a92-4ea2-aa9f-292bb7ad7251 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:49.075177 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e901517f-0a92-4ea2-aa9f-292bb7ad7251 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:49.214865 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e901517f-0a92-4ea2-aa9f-292bb7ad7251 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:49.223401 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e901517f-0a92-4ea2-aa9f-292bb7ad7251 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1554 microversion: 2.1 time: 0.161522 Nov 23 14:40:49.230546 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 688/1347] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:49 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:40:49.374149 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f366720e-169b-44d7-9b76-e2678943124c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:49.461574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f366720e-169b-44d7-9b76-e2678943124c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:49.461574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f366720e-169b-44d7-9b76-e2678943124c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:49.461574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f366720e-169b-44d7-9b76-e2678943124c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:49.461574 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f366720e-169b-44d7-9b76-e2678943124c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:49.461964 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f366720e-169b-44d7-9b76-e2678943124c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:49.462062 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-20f31d9f-788f-4edf-8bf4-e2944b141393 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:49.462062 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-20f31d9f-788f-4edf-8bf4-e2944b141393 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:49.462062 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-20f31d9f-788f-4edf-8bf4-e2944b141393 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:49.462062 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-20f31d9f-788f-4edf-8bf4-e2944b141393 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:49.462391 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-20f31d9f-788f-4edf-8bf4-e2944b141393 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:49.462391 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-20f31d9f-788f-4edf-8bf4-e2944b141393 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:49.524299 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-f366720e-169b-44d7-9b76-e2678943124c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:49.528909 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-20f31d9f-788f-4edf-8bf4-e2944b141393 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080e264b5b294d37b944f74ec75fb5bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f306655ec464f9295fc94d9ce4e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:49.532071 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-f366720e-169b-44d7-9b76-e2678943124c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:49.533128 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-20f31d9f-788f-4edf-8bf4-e2944b141393 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 200 len: 1219 microversion: 2.1 time: 0.084537 Nov 23 14:40:49.534227 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-f366720e-169b-44d7-9b76-e2678943124c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:49.534609 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 689/1348] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:49 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:40:49.535701 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f366720e-169b-44d7-9b76-e2678943124c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.166104 Nov 23 14:40:49.536304 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 660/1349] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:49 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:50.031277 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-869cc9d8-f24c-4da1-ac6d-d228533084b1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:50.032286 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-869cc9d8-f24c-4da1-ac6d-d228533084b1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:50.039029 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-869cc9d8-f24c-4da1-ac6d-d228533084b1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:50.039492 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-869cc9d8-f24c-4da1-ac6d-d228533084b1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:50.040287 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-869cc9d8-f24c-4da1-ac6d-d228533084b1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:50.040751 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-869cc9d8-f24c-4da1-ac6d-d228533084b1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:50.110235 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-869cc9d8-f24c-4da1-ac6d-d228533084b1 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 28642 microversion: 2.1 time: 0.082474 Nov 23 14:40:50.110912 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 690/1350] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:50 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 28642 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:50.240408 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c9b58406-a793-4c2c-82c2-023c5148e550 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:50.241029 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c9b58406-a793-4c2c-82c2-023c5148e550 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:50.247481 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c9b58406-a793-4c2c-82c2-023c5148e550 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:50.247919 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c9b58406-a793-4c2c-82c2-023c5148e550 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:50.248710 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c9b58406-a793-4c2c-82c2-023c5148e550 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:50.249139 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c9b58406-a793-4c2c-82c2-023c5148e550 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:50.386780 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c9b58406-a793-4c2c-82c2-023c5148e550 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:50.395156 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c9b58406-a793-4c2c-82c2-023c5148e550 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1554 microversion: 2.1 time: 0.158524 Nov 23 14:40:50.395920 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 661/1351] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:50 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:40:50.551808 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c2d00be6-9d9f-407d-91e2-db06caaedc64 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:50.552551 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c2d00be6-9d9f-407d-91e2-db06caaedc64 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] [instance: 09d82b41-cf80-4881-975e-eb1d71b0efc7] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:50.554231 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-529d22cf-f6c2-4623-b3e7-63f0def35c5a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:50.554831 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-529d22cf-f6c2-4623-b3e7-63f0def35c5a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:50.559641 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c2d00be6-9d9f-407d-91e2-db06caaedc64 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:50.560090 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c2d00be6-9d9f-407d-91e2-db06caaedc64 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:50.560900 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c2d00be6-9d9f-407d-91e2-db06caaedc64 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:50.561174 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-529d22cf-f6c2-4623-b3e7-63f0def35c5a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:50.561335 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c2d00be6-9d9f-407d-91e2-db06caaedc64 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:50.561617 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-529d22cf-f6c2-4623-b3e7-63f0def35c5a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:50.562456 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-529d22cf-f6c2-4623-b3e7-63f0def35c5a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:50.562944 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-529d22cf-f6c2-4623-b3e7-63f0def35c5a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:50.576548 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-c2d00be6-9d9f-407d-91e2-db06caaedc64 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] HTTP exception thrown: Instance 09d82b41-cf80-4881-975e-eb1d71b0efc7 could not be found. Nov 23 14:40:50.577137 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c2d00be6-9d9f-407d-91e2-db06caaedc64 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Returning 404 to user: Instance 09d82b41-cf80-4881-975e-eb1d71b0efc7 could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:40:50.578016 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c2d00be6-9d9f-407d-91e2-db06caaedc64 tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7" status: 404 len: 111 microversion: 2.1 time: 0.030889 Nov 23 14:40:50.578494 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 691/1352] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:50 2021] GET /compute/v2.1/servers/09d82b41-cf80-4881-975e-eb1d71b0efc7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:40:50.769414 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-529d22cf-f6c2-4623-b3e7-63f0def35c5a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:50.777660 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-529d22cf-f6c2-4623-b3e7-63f0def35c5a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:50.790048 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-529d22cf-f6c2-4623-b3e7-63f0def35c5a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:50.790048 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-529d22cf-f6c2-4623-b3e7-63f0def35c5a tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.229877 Nov 23 14:40:50.790048 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 662/1353] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:50 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:50.858010 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b15922b1-b7a3-40f4-8d48-74d0e5e3ec8a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] Calling method '.version_select at 0x7f2088020af0>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:50.950755 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b15922b1-b7a3-40f4-8d48-74d0e5e3ec8a tempest-TestShelveInstance-703555910 tempest-TestShelveInstance-703555910-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2032644991" status: 202 len: 0 microversion: 2.1 time: 0.096577 Nov 23 14:40:50.951324 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 692/1354] 10.222.0.82 () {58 vars in 1253 bytes} [Tue Nov 23 14:40:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2032644991 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:40:51.122189 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-68a1a532-9b2c-47f0-bcfe-ba8e63d72410 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:51.123039 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-68a1a532-9b2c-47f0-bcfe-ba8e63d72410 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:51.130347 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-68a1a532-9b2c-47f0-bcfe-ba8e63d72410 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:51.130983 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-68a1a532-9b2c-47f0-bcfe-ba8e63d72410 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:51.131772 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-68a1a532-9b2c-47f0-bcfe-ba8e63d72410 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:51.132207 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-68a1a532-9b2c-47f0-bcfe-ba8e63d72410 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:51.253343 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-68a1a532-9b2c-47f0-bcfe-ba8e63d72410 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 29895 microversion: 2.1 time: 0.134245 Nov 23 14:40:51.257443 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 663/1355] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:51 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 29895 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:51.412890 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0baea0ed-c16b-480a-a21a-4a71c04bdf72 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:51.413452 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0baea0ed-c16b-480a-a21a-4a71c04bdf72 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:51.419971 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0baea0ed-c16b-480a-a21a-4a71c04bdf72 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:51.420457 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0baea0ed-c16b-480a-a21a-4a71c04bdf72 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:51.421240 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0baea0ed-c16b-480a-a21a-4a71c04bdf72 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:51.421681 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0baea0ed-c16b-480a-a21a-4a71c04bdf72 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:51.807280 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1c95a4fc-a109-4a5f-a1d1-ffcc9b076250 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:51.807978 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1c95a4fc-a109-4a5f-a1d1-ffcc9b076250 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:51.815588 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1c95a4fc-a109-4a5f-a1d1-ffcc9b076250 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:51.816140 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1c95a4fc-a109-4a5f-a1d1-ffcc9b076250 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:51.816969 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1c95a4fc-a109-4a5f-a1d1-ffcc9b076250 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:51.817391 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1c95a4fc-a109-4a5f-a1d1-ffcc9b076250 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:51.960370 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1c95a4fc-a109-4a5f-a1d1-ffcc9b076250 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:51.968221 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1c95a4fc-a109-4a5f-a1d1-ffcc9b076250 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:51.969725 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1c95a4fc-a109-4a5f-a1d1-ffcc9b076250 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:51.970939 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1c95a4fc-a109-4a5f-a1d1-ffcc9b076250 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.167864 Nov 23 14:40:51.971514 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 664/1356] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:51 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:51.994472 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-0baea0ed-c16b-480a-a21a-4a71c04bdf72 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:52.002624 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0baea0ed-c16b-480a-a21a-4a71c04bdf72 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1554 microversion: 2.1 time: 0.593439 Nov 23 14:40:52.003358 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 693/1357] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:51 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1554 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:40:52.265009 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-4f2c1026-a697-4af5-8f71-c4f2bdfcdc18 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:52.265902 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-4f2c1026-a697-4af5-8f71-c4f2bdfcdc18 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:52.272619 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4f2c1026-a697-4af5-8f71-c4f2bdfcdc18 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:52.273068 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4f2c1026-a697-4af5-8f71-c4f2bdfcdc18 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:52.273869 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4f2c1026-a697-4af5-8f71-c4f2bdfcdc18 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:52.274451 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4f2c1026-a697-4af5-8f71-c4f2bdfcdc18 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:52.354975 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-4f2c1026-a697-4af5-8f71-c4f2bdfcdc18 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 31902 microversion: 2.1 time: 0.093415 Nov 23 14:40:52.355629 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 665/1358] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:52 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 31902 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:40:52.742466 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-13230498-3cc0-48d4-add9-0456c769e7ae req-26d20efe-6fc3-4e4c-9bcc-38196f8be18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f30691a4-e578-4658-afcf-033a9a8ef9fe", "name": "network-vif-deleted", "tag": "18ae7b24-5975-46e7-908e-8cbd192f6d2f"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:52.743963 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:40:52.743963 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:40:52.750974 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-13230498-3cc0-48d4-add9-0456c769e7ae req-26d20efe-6fc3-4e4c-9bcc-38196f8be18e service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:52.751425 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-13230498-3cc0-48d4-add9-0456c769e7ae req-26d20efe-6fc3-4e4c-9bcc-38196f8be18e service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:52.762172 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-13230498-3cc0-48d4-add9-0456c769e7ae req-26d20efe-6fc3-4e4c-9bcc-38196f8be18e service nova] Creating event network-vif-deleted:18ae7b24-5975-46e7-908e-8cbd192f6d2f for instance f30691a4-e578-4658-afcf-033a9a8ef9fe on hv-cinder-80475 Nov 23 14:40:52.767108 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-13230498-3cc0-48d4-add9-0456c769e7ae req-26d20efe-6fc3-4e4c-9bcc-38196f8be18e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085426 Nov 23 14:40:52.770393 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 694/1359] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:40:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:40:52.989820 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c847c012-b6f2-4826-8cbc-df421d0e68dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:52.992656 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c847c012-b6f2-4826-8cbc-df421d0e68dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:52.998709 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c847c012-b6f2-4826-8cbc-df421d0e68dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:52.999292 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c847c012-b6f2-4826-8cbc-df421d0e68dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:53.000173 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c847c012-b6f2-4826-8cbc-df421d0e68dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:53.003126 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c847c012-b6f2-4826-8cbc-df421d0e68dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:53.021842 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e041034d-4690-4afb-8b6c-bae7a89b870a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:53.021842 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-e041034d-4690-4afb-8b6c-bae7a89b870a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:53.027651 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e041034d-4690-4afb-8b6c-bae7a89b870a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:53.028458 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e041034d-4690-4afb-8b6c-bae7a89b870a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:53.029503 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e041034d-4690-4afb-8b6c-bae7a89b870a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:53.030157 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e041034d-4690-4afb-8b6c-bae7a89b870a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:53.090707 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e041034d-4690-4afb-8b6c-bae7a89b870a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:53.091280 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-e041034d-4690-4afb-8b6c-bae7a89b870a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:53.091795 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-e041034d-4690-4afb-8b6c-bae7a89b870a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lazy-loading 'fault' on Instance uuid f30691a4-e578-4658-afcf-033a9a8ef9fe {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:40:53.183110 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-e041034d-4690-4afb-8b6c-bae7a89b870a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04392c74e0e4d288cd856b081f6bb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c896e07f31448e08e2af756467d627d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:53.195879 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e041034d-4690-4afb-8b6c-bae7a89b870a tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 200 len: 1347 microversion: 2.1 time: 0.178693 Nov 23 14:40:53.206728 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 695/1360] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:53 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 1347 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:40:53.217147 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c847c012-b6f2-4826-8cbc-df421d0e68dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:53.225562 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c847c012-b6f2-4826-8cbc-df421d0e68dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:53.227099 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c847c012-b6f2-4826-8cbc-df421d0e68dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:53.228219 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c847c012-b6f2-4826-8cbc-df421d0e68dc tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.242934 Nov 23 14:40:53.228987 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 666/1361] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:52 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:53.367318 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7365181a-b0e9-448e-8d83-4e806feeb34b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:53.368871 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7365181a-b0e9-448e-8d83-4e806feeb34b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:53.375287 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7365181a-b0e9-448e-8d83-4e806feeb34b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:53.376909 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7365181a-b0e9-448e-8d83-4e806feeb34b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:53.378405 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7365181a-b0e9-448e-8d83-4e806feeb34b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:53.378880 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7365181a-b0e9-448e-8d83-4e806feeb34b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:53.456006 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7365181a-b0e9-448e-8d83-4e806feeb34b tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 33184 microversion: 2.1 time: 0.092505 Nov 23 14:40:53.460826 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 696/1362] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:53 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 33184 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:54.215179 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-49a1f74d-5732-471c-add9-222a23fc8cb9 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:54.215179 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-49a1f74d-5732-471c-add9-222a23fc8cb9 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] [instance: f30691a4-e578-4658-afcf-033a9a8ef9fe] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:54.219972 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-49a1f74d-5732-471c-add9-222a23fc8cb9 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:54.220450 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-49a1f74d-5732-471c-add9-222a23fc8cb9 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:54.221912 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-49a1f74d-5732-471c-add9-222a23fc8cb9 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:54.222350 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-49a1f74d-5732-471c-add9-222a23fc8cb9 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:54.238396 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-49a1f74d-5732-471c-add9-222a23fc8cb9 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] HTTP exception thrown: Instance f30691a4-e578-4658-afcf-033a9a8ef9fe could not be found. Nov 23 14:40:54.238988 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-49a1f74d-5732-471c-add9-222a23fc8cb9 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Returning 404 to user: Instance f30691a4-e578-4658-afcf-033a9a8ef9fe could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:40:54.239812 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-49a1f74d-5732-471c-add9-222a23fc8cb9 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe" status: 404 len: 111 microversion: 2.1 time: 0.030725 Nov 23 14:40:54.240460 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 667/1363] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:40:54 2021] GET /compute/v2.1/servers/f30691a4-e578-4658-afcf-033a9a8ef9fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:40:54.247997 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-412a632c-15d2-4472-a21f-da02ddc8fd45 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:54.250016 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-031928e1-7b6a-4cce-8a4a-373e74e70566 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] Calling method '.version_select at 0x7f208807d1f0>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:54.250405 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-412a632c-15d2-4472-a21f-da02ddc8fd45 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:54.258510 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-412a632c-15d2-4472-a21f-da02ddc8fd45 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:54.259087 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-412a632c-15d2-4472-a21f-da02ddc8fd45 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:54.259983 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-412a632c-15d2-4472-a21f-da02ddc8fd45 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:54.260754 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-412a632c-15d2-4472-a21f-da02ddc8fd45 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:54.350720 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-031928e1-7b6a-4cce-8a4a-373e74e70566 tempest-TestMinimumBasicScenario-1101249589 tempest-TestMinimumBasicScenario-1101249589-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-356279930" status: 202 len: 0 microversion: 2.1 time: 0.105870 Nov 23 14:40:54.352578 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 668/1364] 10.222.0.82 () {58 vars in 1268 bytes} [Tue Nov 23 14:40:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-356279930 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 14:40:54.471586 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bdeaa5c1-0995-4795-b874-7c509e1ac5ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:54.471856 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-bdeaa5c1-0995-4795-b874-7c509e1ac5ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:54.479969 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bdeaa5c1-0995-4795-b874-7c509e1ac5ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:54.480449 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bdeaa5c1-0995-4795-b874-7c509e1ac5ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:54.481660 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bdeaa5c1-0995-4795-b874-7c509e1ac5ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:54.482556 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-bdeaa5c1-0995-4795-b874-7c509e1ac5ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:54.484012 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-412a632c-15d2-4472-a21f-da02ddc8fd45 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:54.495378 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-412a632c-15d2-4472-a21f-da02ddc8fd45 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:54.502345 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-412a632c-15d2-4472-a21f-da02ddc8fd45 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:54.502345 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-412a632c-15d2-4472-a21f-da02ddc8fd45 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.257623 Nov 23 14:40:54.512314 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 697/1365] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:54 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:54.625990 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bdeaa5c1-0995-4795-b874-7c509e1ac5ee tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 34204 microversion: 2.1 time: 0.161498 Nov 23 14:40:54.626638 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 669/1366] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:54 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 34204 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:40:55.414216 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-aeb59a41-0ddd-4390-a07a-9f3389d4d849 req-55319dde-77f6-4b67-878a-faf419f643a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2857aac3-a684-44f3-8205-e73b0f8505ce", "name": "network-vif-plugged", "status": "completed", "tag": "34eaa672-bc07-44f3-9bb4-56d1e4fcbcbd"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:55.415844 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:40:55.415844 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:40:55.423139 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-aeb59a41-0ddd-4390-a07a-9f3389d4d849 req-55319dde-77f6-4b67-878a-faf419f643a0 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:55.423648 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-aeb59a41-0ddd-4390-a07a-9f3389d4d849 req-55319dde-77f6-4b67-878a-faf419f643a0 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:55.435296 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-aeb59a41-0ddd-4390-a07a-9f3389d4d849 req-55319dde-77f6-4b67-878a-faf419f643a0 service nova] Creating event network-vif-plugged:34eaa672-bc07-44f3-9bb4-56d1e4fcbcbd for instance 2857aac3-a684-44f3-8205-e73b0f8505ce on hv-cinder-80475 Nov 23 14:40:55.440505 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-aeb59a41-0ddd-4390-a07a-9f3389d4d849 req-55319dde-77f6-4b67-878a-faf419f643a0 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029789 Nov 23 14:40:55.441186 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 698/1367] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:40:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:40:55.522391 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ce688051-5889-438d-ba18-9007b78cd53b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:55.522916 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ce688051-5889-438d-ba18-9007b78cd53b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:55.530240 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ce688051-5889-438d-ba18-9007b78cd53b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:55.532662 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ce688051-5889-438d-ba18-9007b78cd53b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:55.535969 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ce688051-5889-438d-ba18-9007b78cd53b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:55.536713 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ce688051-5889-438d-ba18-9007b78cd53b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:55.638930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-28ec8fa9-5d1c-4dde-a878-ee6163ce969d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:55.639913 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-28ec8fa9-5d1c-4dde-a878-ee6163ce969d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:55.647143 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-28ec8fa9-5d1c-4dde-a878-ee6163ce969d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:55.647593 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-28ec8fa9-5d1c-4dde-a878-ee6163ce969d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:55.648402 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-28ec8fa9-5d1c-4dde-a878-ee6163ce969d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:55.648836 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-28ec8fa9-5d1c-4dde-a878-ee6163ce969d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:55.740437 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-28ec8fa9-5d1c-4dde-a878-ee6163ce969d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 35446 microversion: 2.1 time: 0.105429 Nov 23 14:40:55.742337 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 699/1368] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:55 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 35446 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 14:40:55.907457 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ce688051-5889-438d-ba18-9007b78cd53b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:55.917855 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ce688051-5889-438d-ba18-9007b78cd53b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:55.919678 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ce688051-5889-438d-ba18-9007b78cd53b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:55.921051 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ce688051-5889-438d-ba18-9007b78cd53b tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.405463 Nov 23 14:40:55.921708 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 670/1369] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:55 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:40:56.754347 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ffbdc8f9-b674-481e-8415-a691daeec2ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:56.755976 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ffbdc8f9-b674-481e-8415-a691daeec2ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:56.767652 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ffbdc8f9-b674-481e-8415-a691daeec2ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:56.768493 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ffbdc8f9-b674-481e-8415-a691daeec2ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:56.770885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ffbdc8f9-b674-481e-8415-a691daeec2ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:56.770885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ffbdc8f9-b674-481e-8415-a691daeec2ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:56.866457 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ffbdc8f9-b674-481e-8415-a691daeec2ff tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 36887 microversion: 2.1 time: 0.116495 Nov 23 14:40:56.867903 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 700/1370] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:56 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 36887 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:56.941064 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a4960ae0-3293-4fb8-935e-804a1e6c381c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:56.941710 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a4960ae0-3293-4fb8-935e-804a1e6c381c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:56.952741 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a4960ae0-3293-4fb8-935e-804a1e6c381c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:56.960281 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a4960ae0-3293-4fb8-935e-804a1e6c381c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:56.960281 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a4960ae0-3293-4fb8-935e-804a1e6c381c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:56.960281 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a4960ae0-3293-4fb8-935e-804a1e6c381c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:57.524595 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a4960ae0-3293-4fb8-935e-804a1e6c381c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:57.533599 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a4960ae0-3293-4fb8-935e-804a1e6c381c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:57.535571 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a4960ae0-3293-4fb8-935e-804a1e6c381c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:57.536776 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a4960ae0-3293-4fb8-935e-804a1e6c381c tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.600382 Nov 23 14:40:57.537663 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 671/1371] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:56 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:57.881097 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1b01195c-861d-461f-8c6a-229778a04781 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:57.882100 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1b01195c-861d-461f-8c6a-229778a04781 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:57.889956 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1b01195c-861d-461f-8c6a-229778a04781 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:57.891511 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1b01195c-861d-461f-8c6a-229778a04781 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:57.892683 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1b01195c-861d-461f-8c6a-229778a04781 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:57.893426 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1b01195c-861d-461f-8c6a-229778a04781 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:57.984450 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1b01195c-861d-461f-8c6a-229778a04781 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 38166 microversion: 2.1 time: 0.108826 Nov 23 14:40:57.989328 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 701/1372] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:57 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 38166 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:58.559411 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3dd1b83f-fc7b-42ae-a0a0-f9552ad9c978 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:58.560024 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3dd1b83f-fc7b-42ae-a0a0-f9552ad9c978 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:58.567239 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3dd1b83f-fc7b-42ae-a0a0-f9552ad9c978 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:58.567832 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3dd1b83f-fc7b-42ae-a0a0-f9552ad9c978 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:58.568650 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3dd1b83f-fc7b-42ae-a0a0-f9552ad9c978 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:58.569085 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3dd1b83f-fc7b-42ae-a0a0-f9552ad9c978 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:58.844557 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-3dd1b83f-fc7b-42ae-a0a0-f9552ad9c978 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:58.852795 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-3dd1b83f-fc7b-42ae-a0a0-f9552ad9c978 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:58.854267 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-3dd1b83f-fc7b-42ae-a0a0-f9552ad9c978 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:40:58.860364 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3dd1b83f-fc7b-42ae-a0a0-f9552ad9c978 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1731 microversion: 2.20 time: 0.302907 Nov 23 14:40:58.860364 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 672/1373] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:58 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1731 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:40:58.999982 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7dc9563a-83c1-4fc6-a973-cc4bddadd324 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:40:59.001193 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7dc9563a-83c1-4fc6-a973-cc4bddadd324 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:59.031699 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7dc9563a-83c1-4fc6-a973-cc4bddadd324 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:59.032162 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7dc9563a-83c1-4fc6-a973-cc4bddadd324 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:59.033092 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7dc9563a-83c1-4fc6-a973-cc4bddadd324 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:59.033534 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7dc9563a-83c1-4fc6-a973-cc4bddadd324 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:59.107015 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7dc9563a-83c1-4fc6-a973-cc4bddadd324 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 38166 microversion: 2.1 time: 0.113192 Nov 23 14:40:59.108057 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 702/1374] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:40:58 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 38166 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:40:59.873246 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d32698fe-5a7c-4065-9b53-6284f29d2bb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:40:59.873856 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d32698fe-5a7c-4065-9b53-6284f29d2bb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:40:59.884501 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d32698fe-5a7c-4065-9b53-6284f29d2bb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:59.885186 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d32698fe-5a7c-4065-9b53-6284f29d2bb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:40:59.886162 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d32698fe-5a7c-4065-9b53-6284f29d2bb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:40:59.886752 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d32698fe-5a7c-4065-9b53-6284f29d2bb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:00.072002 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d32698fe-5a7c-4065-9b53-6284f29d2bb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:41:00.110315 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d32698fe-5a7c-4065-9b53-6284f29d2bb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:41:00.114497 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d32698fe-5a7c-4065-9b53-6284f29d2bb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:41:00.118010 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d32698fe-5a7c-4065-9b53-6284f29d2bb8 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1718 microversion: 2.20 time: 0.248565 Nov 23 14:41:00.120028 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 673/1375] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:40:59 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1718 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:41:00.132386 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-841b899e-abe2-498c-8b67-cc443ba721cd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:41:00.133496 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-841b899e-abe2-498c-8b67-cc443ba721cd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:00.148997 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-841b899e-abe2-498c-8b67-cc443ba721cd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:00.154769 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-841b899e-abe2-498c-8b67-cc443ba721cd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:00.155663 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-841b899e-abe2-498c-8b67-cc443ba721cd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:00.156126 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-841b899e-abe2-498c-8b67-cc443ba721cd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:00.234976 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-841b899e-abe2-498c-8b67-cc443ba721cd tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 38166 microversion: 2.1 time: 0.119260 Nov 23 14:41:00.239708 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 703/1376] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:41:00 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 38166 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:41:01.247739 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b5f72df3-805f-4797-ad46-35dc77e49bd8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:41:01.248583 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b5f72df3-805f-4797-ad46-35dc77e49bd8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:01.255519 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b5f72df3-805f-4797-ad46-35dc77e49bd8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:01.256053 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b5f72df3-805f-4797-ad46-35dc77e49bd8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:01.257124 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b5f72df3-805f-4797-ad46-35dc77e49bd8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:01.257644 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b5f72df3-805f-4797-ad46-35dc77e49bd8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:01.323481 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b5f72df3-805f-4797-ad46-35dc77e49bd8 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 38166 microversion: 2.1 time: 0.079590 Nov 23 14:41:01.329526 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 674/1377] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:41:01 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 38166 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:41:02.338474 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-81545f38-dd6c-492e-85dd-a36b1eb89f42 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:41:02.341212 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-81545f38-dd6c-492e-85dd-a36b1eb89f42 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:02.349370 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-81545f38-dd6c-492e-85dd-a36b1eb89f42 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:02.352850 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-81545f38-dd6c-492e-85dd-a36b1eb89f42 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:02.352850 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-81545f38-dd6c-492e-85dd-a36b1eb89f42 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:02.352850 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-81545f38-dd6c-492e-85dd-a36b1eb89f42 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:02.438903 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-81545f38-dd6c-492e-85dd-a36b1eb89f42 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action" status: 200 len: 38297 microversion: 2.1 time: 0.104426 Nov 23 14:41:02.439807 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 704/1378] 10.222.0.82 () {60 vars in 1277 bytes} [Tue Nov 23 14:41:02 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/action => generated 38297 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 14:41:02.449727 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-647e253d-a011-4923-8395-42038a34d8cf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:02.450377 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-647e253d-a011-4923-8395-42038a34d8cf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:02.457443 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-647e253d-a011-4923-8395-42038a34d8cf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:02.457890 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-647e253d-a011-4923-8395-42038a34d8cf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:02.458669 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-647e253d-a011-4923-8395-42038a34d8cf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:02.459103 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-647e253d-a011-4923-8395-42038a34d8cf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:02.484670 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-647e253d-a011-4923-8395-42038a34d8cf tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/ips" status: 200 len: 144 microversion: 2.1 time: 0.038920 Nov 23 14:41:02.485230 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 675/1379] 10.222.0.82 () {58 vars in 1247 bytes} [Tue Nov 23 14:41:02 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:04.072854 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-80dcc734-fce2-4802-9126-ca5885b16739 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a6a193a-461a-424a-9870-9b73cfb5f523"}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:41:04.074112 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-80dcc734-fce2-4802-9126-ca5885b16739 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:04.081266 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-80dcc734-fce2-4802-9126-ca5885b16739 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:04.081715 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-80dcc734-fce2-4802-9126-ca5885b16739 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:04.082488 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-80dcc734-fce2-4802-9126-ca5885b16739 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:04.082919 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-80dcc734-fce2-4802-9126-ca5885b16739 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:04.741838 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-80dcc734-fce2-4802-9126-ca5885b16739 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.672952 Nov 23 14:41:04.742339 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 705/1380] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Nov 23 14:41:04 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments => generated 194 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:12.202907 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-acf42998-7a27-439a-81e1-981e386fae5a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:12.203811 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-acf42998-7a27-439a-81e1-981e386fae5a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:12.210323 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-acf42998-7a27-439a-81e1-981e386fae5a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:12.210774 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-acf42998-7a27-439a-81e1-981e386fae5a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:12.211547 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-acf42998-7a27-439a-81e1-981e386fae5a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:12.211990 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-acf42998-7a27-439a-81e1-981e386fae5a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:12.241366 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-acf42998-7a27-439a-81e1-981e386fae5a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042190 Nov 23 14:41:12.241907 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 676/1381] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:41:12 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:12.252813 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-86eb0b96-5c5d-4aaf-a8aa-7796866a295c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:12.253397 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-86eb0b96-5c5d-4aaf-a8aa-7796866a295c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:12.259287 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-86eb0b96-5c5d-4aaf-a8aa-7796866a295c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:12.259729 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-86eb0b96-5c5d-4aaf-a8aa-7796866a295c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:12.260525 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-86eb0b96-5c5d-4aaf-a8aa-7796866a295c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:12.260955 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-86eb0b96-5c5d-4aaf-a8aa-7796866a295c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:12.288764 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-86eb0b96-5c5d-4aaf-a8aa-7796866a295c tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments/6a6a193a-461a-424a-9870-9b73cfb5f523" status: 200 len: 194 microversion: 2.1 time: 0.040617 Nov 23 14:41:12.290224 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 706/1382] 10.222.0.82 () {58 vars in 1412 bytes} [Tue Nov 23 14:41:12 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments/6a6a193a-461a-424a-9870-9b73cfb5f523 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:13.830850 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-2c761fa0-16bb-4e87-83dd-522ef2e00f25 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "218f4f76-ace9-4581-82b1-8289b3ed0e34"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:41:13.832039 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-2c761fa0-16bb-4e87-83dd-522ef2e00f25 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:13.838292 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2c761fa0-16bb-4e87-83dd-522ef2e00f25 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:13.838738 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2c761fa0-16bb-4e87-83dd-522ef2e00f25 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:13.839514 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2c761fa0-16bb-4e87-83dd-522ef2e00f25 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:13.839944 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-2c761fa0-16bb-4e87-83dd-522ef2e00f25 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:14.581204 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-2c761fa0-16bb-4e87-83dd-522ef2e00f25 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.754153 Nov 23 14:41:14.582948 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 677/1383] 10.222.0.82 () {60 vars in 1322 bytes} [Tue Nov 23 14:41:13 2021] POST /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments => generated 194 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:22.037885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b3ff34d0-132d-4e56-a597-4b7d8ff113b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:22.038799 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b3ff34d0-132d-4e56-a597-4b7d8ff113b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:22.045036 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b3ff34d0-132d-4e56-a597-4b7d8ff113b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:22.045482 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b3ff34d0-132d-4e56-a597-4b7d8ff113b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:22.046248 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b3ff34d0-132d-4e56-a597-4b7d8ff113b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:22.046684 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b3ff34d0-132d-4e56-a597-4b7d8ff113b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:22.074740 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b3ff34d0-132d-4e56-a597-4b7d8ff113b3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041420 Nov 23 14:41:22.075272 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 707/1384] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:41:22 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:22.311160 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9a7f40c7-4719-485d-9611-0a12c046dc87 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:22.311734 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9a7f40c7-4719-485d-9611-0a12c046dc87 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:22.318819 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9a7f40c7-4719-485d-9611-0a12c046dc87 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:22.319258 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9a7f40c7-4719-485d-9611-0a12c046dc87 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:22.320026 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9a7f40c7-4719-485d-9611-0a12c046dc87 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:22.320492 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9a7f40c7-4719-485d-9611-0a12c046dc87 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:22.348978 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9a7f40c7-4719-485d-9611-0a12c046dc87 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments/6a6a193a-461a-424a-9870-9b73cfb5f523" status: 200 len: 194 microversion: 2.1 time: 0.041908 Nov 23 14:41:22.349562 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 678/1385] 10.222.0.82 () {58 vars in 1412 bytes} [Tue Nov 23 14:41:22 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments/6a6a193a-461a-424a-9870-9b73cfb5f523 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:22.358812 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b9a3bafe-800f-4bb8-b699-e1b6b3a9aef0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:22.359325 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b9a3bafe-800f-4bb8-b699-e1b6b3a9aef0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:22.365106 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b9a3bafe-800f-4bb8-b699-e1b6b3a9aef0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:22.365550 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b9a3bafe-800f-4bb8-b699-e1b6b3a9aef0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:22.366320 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b9a3bafe-800f-4bb8-b699-e1b6b3a9aef0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:22.366745 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b9a3bafe-800f-4bb8-b699-e1b6b3a9aef0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:22.443776 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-b9a3bafe-800f-4bb8-b699-e1b6b3a9aef0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lazy-loading 'services' on Instance uuid 07539cec-d8ef-485e-84d8-9bd690c4397e {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:41:22.622042 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b9a3bafe-800f-4bb8-b699-e1b6b3a9aef0 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "DELETE /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments/6a6a193a-461a-424a-9870-9b73cfb5f523" status: 202 len: 0 microversion: 2.1 time: 0.266730 Nov 23 14:41:22.622623 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 708/1386] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Nov 23 14:41:22 2021] DELETE /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments/6a6a193a-461a-424a-9870-9b73cfb5f523 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:41:24.778538 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b14502bb-c734-4703-b088-ec970621c89a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:24.779044 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b14502bb-c734-4703-b088-ec970621c89a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:24.785386 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b14502bb-c734-4703-b088-ec970621c89a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:24.785822 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b14502bb-c734-4703-b088-ec970621c89a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:24.786581 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b14502bb-c734-4703-b088-ec970621c89a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:24.787007 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b14502bb-c734-4703-b088-ec970621c89a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:24.814661 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b14502bb-c734-4703-b088-ec970621c89a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments/218f4f76-ace9-4581-82b1-8289b3ed0e34" status: 200 len: 194 microversion: 2.1 time: 0.039816 Nov 23 14:41:24.815221 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 679/1387] 10.222.0.82 () {58 vars in 1412 bytes} [Tue Nov 23 14:41:24 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments/218f4f76-ace9-4581-82b1-8289b3ed0e34 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:24.826685 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-072fc303-9161-46ea-a763-db8420bec867 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:24.827302 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-072fc303-9161-46ea-a763-db8420bec867 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:24.833955 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-072fc303-9161-46ea-a763-db8420bec867 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:24.834442 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-072fc303-9161-46ea-a763-db8420bec867 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:24.835221 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-072fc303-9161-46ea-a763-db8420bec867 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:24.835656 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-072fc303-9161-46ea-a763-db8420bec867 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:24.911797 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-072fc303-9161-46ea-a763-db8420bec867 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lazy-loading 'services' on Instance uuid 07539cec-d8ef-485e-84d8-9bd690c4397e {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:41:25.141810 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-072fc303-9161-46ea-a763-db8420bec867 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "DELETE /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments/218f4f76-ace9-4581-82b1-8289b3ed0e34" status: 202 len: 0 microversion: 2.1 time: 0.319475 Nov 23 14:41:25.142506 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 709/1388] 10.222.0.82 () {58 vars in 1415 bytes} [Tue Nov 23 14:41:24 2021] DELETE /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments/218f4f76-ace9-4581-82b1-8289b3ed0e34 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:41:26.288707 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f59eb8aa-68cb-4d5f-899d-a2e3f3b54780 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:26.289663 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f59eb8aa-68cb-4d5f-899d-a2e3f3b54780 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:26.295879 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f59eb8aa-68cb-4d5f-899d-a2e3f3b54780 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:26.296713 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f59eb8aa-68cb-4d5f-899d-a2e3f3b54780 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:26.297129 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f59eb8aa-68cb-4d5f-899d-a2e3f3b54780 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:26.297773 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f59eb8aa-68cb-4d5f-899d-a2e3f3b54780 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:26.327704 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f59eb8aa-68cb-4d5f-899d-a2e3f3b54780 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042730 Nov 23 14:41:26.328258 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 680/1389] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:41:26 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:41:26.427459 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-56012e38-31d0-4d28-983a-5dbfca0d0cb3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:26.428530 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-56012e38-31d0-4d28-983a-5dbfca0d0cb3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:26.434467 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-56012e38-31d0-4d28-983a-5dbfca0d0cb3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:26.434907 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-56012e38-31d0-4d28-983a-5dbfca0d0cb3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:26.435669 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-56012e38-31d0-4d28-983a-5dbfca0d0cb3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:26.436097 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-56012e38-31d0-4d28-983a-5dbfca0d0cb3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:26.463937 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-56012e38-31d0-4d28-983a-5dbfca0d0cb3 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041486 Nov 23 14:41:26.464511 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 710/1390] 10.222.0.82 () {58 vars in 1301 bytes} [Tue Nov 23 14:41:26 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 14:41:26.518186 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-94c4af6e-53a3-483d-9795-8f524188a435 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:26.518738 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-94c4af6e-53a3-483d-9795-8f524188a435 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:26.524454 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-94c4af6e-53a3-483d-9795-8f524188a435 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:26.524903 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-94c4af6e-53a3-483d-9795-8f524188a435 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:26.525699 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-94c4af6e-53a3-483d-9795-8f524188a435 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:26.526131 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-94c4af6e-53a3-483d-9795-8f524188a435 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:26.549476 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-94c4af6e-53a3-483d-9795-8f524188a435 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Going to try to terminate instance {{(pid=116788) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:41:26.776908 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-94c4af6e-53a3-483d-9795-8f524188a435 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "DELETE /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 204 len: 0 microversion: 2.1 time: 0.261983 Nov 23 14:41:26.777501 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 681/1391] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:41:26 2021] DELETE /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 14:41:26.786220 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-af51a1b8-0fd5-4ee4-ae53-2cf475e8980a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:26.786829 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-af51a1b8-0fd5-4ee4-ae53-2cf475e8980a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:26.792567 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-af51a1b8-0fd5-4ee4-ae53-2cf475e8980a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:26.793008 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-af51a1b8-0fd5-4ee4-ae53-2cf475e8980a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:26.793818 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-af51a1b8-0fd5-4ee4-ae53-2cf475e8980a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:26.794228 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-af51a1b8-0fd5-4ee4-ae53-2cf475e8980a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:26.927910 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-af51a1b8-0fd5-4ee4-ae53-2cf475e8980a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:41:26.933432 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-af51a1b8-0fd5-4ee4-ae53-2cf475e8980a tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 200 len: 1673 microversion: 2.1 time: 0.151535 Nov 23 14:41:26.934034 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 711/1392] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:41:26 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:41:27.951204 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-015bb32f-b8f2-489d-a301-5cd08e535d20 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:27.951898 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-015bb32f-b8f2-489d-a301-5cd08e535d20 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:27.958973 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-015bb32f-b8f2-489d-a301-5cd08e535d20 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:27.959423 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-015bb32f-b8f2-489d-a301-5cd08e535d20 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:27.960202 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-015bb32f-b8f2-489d-a301-5cd08e535d20 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:27.960669 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-015bb32f-b8f2-489d-a301-5cd08e535d20 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:28.089431 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-015bb32f-b8f2-489d-a301-5cd08e535d20 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:41:28.097199 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-015bb32f-b8f2-489d-a301-5cd08e535d20 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 200 len: 1673 microversion: 2.1 time: 0.149436 Nov 23 14:41:28.097765 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 682/1393] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:41:27 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:41:29.113722 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6cff9896-6fee-4c6a-89aa-01fd24c7f04d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:29.114309 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6cff9896-6fee-4c6a-89aa-01fd24c7f04d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:29.121131 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6cff9896-6fee-4c6a-89aa-01fd24c7f04d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:29.121557 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6cff9896-6fee-4c6a-89aa-01fd24c7f04d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:29.122342 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6cff9896-6fee-4c6a-89aa-01fd24c7f04d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:29.122767 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6cff9896-6fee-4c6a-89aa-01fd24c7f04d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:29.654950 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6cff9896-6fee-4c6a-89aa-01fd24c7f04d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:41:29.663306 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6cff9896-6fee-4c6a-89aa-01fd24c7f04d tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 200 len: 1673 microversion: 2.1 time: 0.553466 Nov 23 14:41:29.663885 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 712/1394] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:41:29 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 1673 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:41:30.213824 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-bf795a2b-b44d-4536-be27-c8e6e339f14a req-593314c3-eb6b-4b96-8034-2bfc430e36c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07539cec-d8ef-485e-84d8-9bd690c4397e", "name": "network-vif-deleted", "tag": "6955538e-583a-4e78-9edb-e27c4276b423"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:41:30.215989 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:41:30.215989 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:41:30.223520 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-bf795a2b-b44d-4536-be27-c8e6e339f14a req-593314c3-eb6b-4b96-8034-2bfc430e36c8 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:30.223957 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-bf795a2b-b44d-4536-be27-c8e6e339f14a req-593314c3-eb6b-4b96-8034-2bfc430e36c8 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:30.234653 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-bf795a2b-b44d-4536-be27-c8e6e339f14a req-593314c3-eb6b-4b96-8034-2bfc430e36c8 service nova] Creating event network-vif-deleted:6955538e-583a-4e78-9edb-e27c4276b423 for instance 07539cec-d8ef-485e-84d8-9bd690c4397e on hv-cinder-80475 Nov 23 14:41:30.240424 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-bf795a2b-b44d-4536-be27-c8e6e339f14a req-593314c3-eb6b-4b96-8034-2bfc430e36c8 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030464 Nov 23 14:41:30.241200 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 683/1395] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:41:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:30.680599 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7e7ef7b6-efc2-4ac6-99c6-0dc5179c38fc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:30.682051 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7e7ef7b6-efc2-4ac6-99c6-0dc5179c38fc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:30.688608 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7e7ef7b6-efc2-4ac6-99c6-0dc5179c38fc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:30.689292 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7e7ef7b6-efc2-4ac6-99c6-0dc5179c38fc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:30.690891 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7e7ef7b6-efc2-4ac6-99c6-0dc5179c38fc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:30.691463 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7e7ef7b6-efc2-4ac6-99c6-0dc5179c38fc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:30.722697 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7e7ef7b6-efc2-4ac6-99c6-0dc5179c38fc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:30.723146 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7e7ef7b6-efc2-4ac6-99c6-0dc5179c38fc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:30.723601 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.objects.instance [None req-7e7ef7b6-efc2-4ac6-99c6-0dc5179c38fc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lazy-loading 'fault' on Instance uuid 07539cec-d8ef-485e-84d8-9bd690c4397e {{(pid=116787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:41:30.770437 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7e7ef7b6-efc2-4ac6-99c6-0dc5179c38fc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b0720c8f9b47888a5e315c01ac65bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd08103499348da976aa1b8d926a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:41:30.777888 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7e7ef7b6-efc2-4ac6-99c6-0dc5179c38fc tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 200 len: 1328 microversion: 2.1 time: 0.101186 Nov 23 14:41:30.778562 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 713/1396] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:41:30 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:41:31.795460 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-26a9bd41-5f7c-482a-8924-8e46b731acab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:31.796057 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-26a9bd41-5f7c-482a-8924-8e46b731acab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:31.803436 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-26a9bd41-5f7c-482a-8924-8e46b731acab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:31.803882 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-26a9bd41-5f7c-482a-8924-8e46b731acab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:31.804699 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-26a9bd41-5f7c-482a-8924-8e46b731acab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:31.805130 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-26a9bd41-5f7c-482a-8924-8e46b731acab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:31.819920 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-26a9bd41-5f7c-482a-8924-8e46b731acab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] HTTP exception thrown: Instance 07539cec-d8ef-485e-84d8-9bd690c4397e could not be found. Nov 23 14:41:31.820534 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-26a9bd41-5f7c-482a-8924-8e46b731acab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Returning 404 to user: Instance 07539cec-d8ef-485e-84d8-9bd690c4397e could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:41:31.821348 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-26a9bd41-5f7c-482a-8924-8e46b731acab tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 404 len: 111 microversion: 2.1 time: 0.030163 Nov 23 14:41:31.821884 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 684/1397] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:41:31 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:41:31.829998 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-8e884141-3090-4003-8dd4-31b33fe59c24 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '.version_select at 0x7f20880afc10>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:31.897486 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-8e884141-3090-4003-8dd4-31b33fe59c24 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082061902" status: 202 len: 0 microversion: 2.1 time: 0.071037 Nov 23 14:41:31.898059 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 714/1398] 10.222.0.82 () {58 vars in 1220 bytes} [Tue Nov 23 14:41:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082061902 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:41:35.083733 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-406c4915-6ceb-459c-88f0-ba1cf6d1a817 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:35.084230 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-406c4915-6ceb-459c-88f0-ba1cf6d1a817 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:35.090393 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-406c4915-6ceb-459c-88f0-ba1cf6d1a817 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:35.090899 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-406c4915-6ceb-459c-88f0-ba1cf6d1a817 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:35.091665 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-406c4915-6ceb-459c-88f0-ba1cf6d1a817 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:35.092094 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-406c4915-6ceb-459c-88f0-ba1cf6d1a817 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:35.105284 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-406c4915-6ceb-459c-88f0-ba1cf6d1a817 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] HTTP exception thrown: Instance 07539cec-d8ef-485e-84d8-9bd690c4397e could not be found. Nov 23 14:41:35.105867 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-406c4915-6ceb-459c-88f0-ba1cf6d1a817 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Returning 404 to user: Instance 07539cec-d8ef-485e-84d8-9bd690c4397e could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:41:35.106688 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-406c4915-6ceb-459c-88f0-ba1cf6d1a817 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "DELETE /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 404 len: 111 microversion: 2.1 time: 0.027462 Nov 23 14:41:35.107217 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 685/1399] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:41:35 2021] DELETE /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:41:35.115574 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0325d414-f0b5-49dc-953e-cd7a1fdfb2da tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:35.116898 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-0325d414-f0b5-49dc-953e-cd7a1fdfb2da tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: 07539cec-d8ef-485e-84d8-9bd690c4397e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:35.122906 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0325d414-f0b5-49dc-953e-cd7a1fdfb2da tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:35.123356 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0325d414-f0b5-49dc-953e-cd7a1fdfb2da tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:35.124130 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0325d414-f0b5-49dc-953e-cd7a1fdfb2da tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:35.124596 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-0325d414-f0b5-49dc-953e-cd7a1fdfb2da tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:35.139318 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-0325d414-f0b5-49dc-953e-cd7a1fdfb2da tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] HTTP exception thrown: Instance 07539cec-d8ef-485e-84d8-9bd690c4397e could not be found. Nov 23 14:41:35.139976 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-0325d414-f0b5-49dc-953e-cd7a1fdfb2da tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Returning 404 to user: Instance 07539cec-d8ef-485e-84d8-9bd690c4397e could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:41:35.140817 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-0325d414-f0b5-49dc-953e-cd7a1fdfb2da tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e" status: 404 len: 111 microversion: 2.1 time: 0.029589 Nov 23 14:41:35.141348 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 715/1400] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:41:35 2021] GET /compute/v2.1/servers/07539cec-d8ef-485e-84d8-9bd690c4397e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:41:36.363363 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-667d644d-0514-4406-b7b2-c0047be61291 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:36.364164 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-667d644d-0514-4406-b7b2-c0047be61291 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:36.370815 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-667d644d-0514-4406-b7b2-c0047be61291 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:36.371266 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-667d644d-0514-4406-b7b2-c0047be61291 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:36.372072 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-667d644d-0514-4406-b7b2-c0047be61291 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:36.372543 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-667d644d-0514-4406-b7b2-c0047be61291 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:36.386186 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-667d644d-0514-4406-b7b2-c0047be61291 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] HTTP exception thrown: Instance ace5aa86-e88f-49e1-b497-966c499eba99 could not be found. Nov 23 14:41:36.386773 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-667d644d-0514-4406-b7b2-c0047be61291 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Returning 404 to user: Instance ace5aa86-e88f-49e1-b497-966c499eba99 could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:41:36.387587 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-667d644d-0514-4406-b7b2-c0047be61291 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "DELETE /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 404 len: 111 microversion: 2.1 time: 0.027889 Nov 23 14:41:36.388115 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 686/1401] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:41:36 2021] DELETE /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:41:36.396672 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d9578a57-3de6-4dbd-9d25-3be9b393cc92 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:36.397281 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d9578a57-3de6-4dbd-9d25-3be9b393cc92 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] [instance: ace5aa86-e88f-49e1-b497-966c499eba99] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:36.403484 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d9578a57-3de6-4dbd-9d25-3be9b393cc92 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:36.403933 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d9578a57-3de6-4dbd-9d25-3be9b393cc92 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:36.404747 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d9578a57-3de6-4dbd-9d25-3be9b393cc92 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:36.405181 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d9578a57-3de6-4dbd-9d25-3be9b393cc92 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:36.417913 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-d9578a57-3de6-4dbd-9d25-3be9b393cc92 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] HTTP exception thrown: Instance ace5aa86-e88f-49e1-b497-966c499eba99 could not be found. Nov 23 14:41:36.418486 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d9578a57-3de6-4dbd-9d25-3be9b393cc92 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] Returning 404 to user: Instance ace5aa86-e88f-49e1-b497-966c499eba99 could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:41:36.419298 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d9578a57-3de6-4dbd-9d25-3be9b393cc92 tempest-AttachVolumeTestJSON-71339206 tempest-AttachVolumeTestJSON-71339206-project] 10.222.0.82 "GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99" status: 404 len: 111 microversion: 2.1 time: 0.027045 Nov 23 14:41:36.419795 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 716/1402] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:41:36 2021] GET /compute/v2.1/servers/ace5aa86-e88f-49e1-b497-966c499eba99 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:41:43.130018 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-cdcb849e-5205-45a9-9550-711e7fe4c845 tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] Calling method '.version_select at 0x7f20880ca670>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:43.175056 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-cdcb849e-5205-45a9-9550-711e7fe4c845 tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/a22f7268-2704-44cb-9553-138976e3041f" status: 200 len: 351 microversion: 2.1 time: 0.048590 Nov 23 14:41:43.175617 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 687/1403] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Nov 23 14:41:43 2021] GET /compute/v2.1/os-volumes/a22f7268-2704-44cb-9553-138976e3041f => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:44.762879 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-bbb9c6ed-71b6-4d41-95e2-5ce4d4ca5108 tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] Calling method '.version_select at 0x7f208832cee0>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:44.808705 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-bbb9c6ed-71b6-4d41-95e2-5ce4d4ca5108 tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/67737460-4faa-4fcf-8d39-13912bfed7b5" status: 200 len: 351 microversion: 2.1 time: 0.049276 Nov 23 14:41:44.809264 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 717/1404] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Nov 23 14:41:44 2021] GET /compute/v2.1/os-volumes/67737460-4faa-4fcf-8d39-13912bfed7b5 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:46.360131 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-39baf53b-eb61-466b-acd4-d99c9c662e37 tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] Calling method '.version_select at 0x7f208813fca0>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:46.405925 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-39baf53b-eb61-466b-acd4-d99c9c662e37 tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/48cecac3-8fb1-45fc-8d3b-0278726458b7" status: 200 len: 351 microversion: 2.1 time: 0.049765 Nov 23 14:41:46.406528 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 688/1405] 10.222.0.82 () {58 vars in 1244 bytes} [Tue Nov 23 14:41:46 2021] GET /compute/v2.1/os-volumes/48cecac3-8fb1-45fc-8d3b-0278726458b7 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:46.418732 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-de71acde-e63c-4d89-91bc-d41b43204618 tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] Calling method '.version_select at 0x7f2088061af0>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:46.495859 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-de71acde-e63c-4d89-91bc-d41b43204618 tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] 10.222.0.82 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.081186 Nov 23 14:41:46.496458 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 718/1406] 10.222.0.82 () {58 vars in 1133 bytes} [Tue Nov 23 14:41:46 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:41:46.508353 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-749d2a90-5a62-4b60-b06c-36ded0c30d8c tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] Calling method '.version_select at 0x7f20827578b0>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:46.586966 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-749d2a90-5a62-4b60-b06c-36ded0c30d8c tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] 10.222.0.82 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.082359 Nov 23 14:41:46.587540 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 689/1407] 10.222.0.82 () {58 vars in 1148 bytes} [Tue Nov 23 14:41:46 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:46.599071 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-53cf382b-caa4-4015-8fcf-68f5a9461c1a tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] Calling method '.version_select at 0x7f208816f280>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:46.676705 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-53cf382b-caa4-4015-8fcf-68f5a9461c1a tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] 10.222.0.82 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.081115 Nov 23 14:41:46.678111 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 719/1408] 10.222.0.82 () {58 vars in 1133 bytes} [Tue Nov 23 14:41:46 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:41:46.688909 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ad11c7a2-a6b3-4f87-8200-08397e9d177c tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] Calling method '.version_select at 0x7f20827d0af0>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:46.768843 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ad11c7a2-a6b3-4f87-8200-08397e9d177c tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] 10.222.0.82 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083375 Nov 23 14:41:46.769412 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 690/1409] 10.222.0.82 () {58 vars in 1166 bytes} [Tue Nov 23 14:41:46 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:46.780799 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-38dac122-9af6-461c-bcf6-c6139f147da8 tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] Calling method '.version_select at 0x7f208832c280>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:46.861781 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-38dac122-9af6-461c-bcf6-c6139f147da8 tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084443 Nov 23 14:41:46.862351 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 720/1410] 10.222.0.82 () {58 vars in 1169 bytes} [Tue Nov 23 14:41:46 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:46.874885 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7d4c6e16-abdd-4245-9e5c-fa70ec58111b tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] Calling method '.version_select at 0x7f208832e4c0>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:46.952129 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7d4c6e16-abdd-4245-9e5c-fa70ec58111b tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.080751 Nov 23 14:41:46.952723 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 691/1411] 10.222.0.82 () {58 vars in 1154 bytes} [Tue Nov 23 14:41:46 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:41:46.963631 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-16b1a4e2-009a-41d8-9d96-d539534615f7 tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] Calling method '.version_select at 0x7f2088038550>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:47.046202 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-16b1a4e2-009a-41d8-9d96-d539534615f7 tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086046 Nov 23 14:41:47.046783 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 721/1412] 10.222.0.82 () {58 vars in 1187 bytes} [Tue Nov 23 14:41:46 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:47.059360 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b9bccd93-51c0-4757-8889-ed1b4a4a46df tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] Calling method '.version_select at 0x7f20827d3040>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:47.139312 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b9bccd93-51c0-4757-8889-ed1b4a4a46df tempest-VolumesTestJSON-776752995 tempest-VolumesTestJSON-776752995-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.083629 Nov 23 14:41:47.139883 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 692/1413] 10.222.0.82 () {58 vars in 1154 bytes} [Tue Nov 23 14:41:47 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:41:55.623400 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ae42df2d-d608-4aa0-8634-36a0af4350c0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:55.624227 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ae42df2d-d608-4aa0-8634-36a0af4350c0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:55.630070 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ae42df2d-d608-4aa0-8634-36a0af4350c0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:55.632759 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ae42df2d-d608-4aa0-8634-36a0af4350c0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:55.632759 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ae42df2d-d608-4aa0-8634-36a0af4350c0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:55.632759 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ae42df2d-d608-4aa0-8634-36a0af4350c0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:55.662264 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ae42df2d-d608-4aa0-8634-36a0af4350c0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042905 Nov 23 14:41:55.663703 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 722/1414] 10.222.0.82 () {60 vars in 1342 bytes} [Tue Nov 23 14:41:55 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:41:55.719065 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b91a6c83-53fb-4266-85b5-52ceb57d84ce tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:55.719593 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b91a6c83-53fb-4266-85b5-52ceb57d84ce tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:55.726217 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b91a6c83-53fb-4266-85b5-52ceb57d84ce tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:55.726783 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b91a6c83-53fb-4266-85b5-52ceb57d84ce tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:55.727561 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b91a6c83-53fb-4266-85b5-52ceb57d84ce tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:55.727998 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b91a6c83-53fb-4266-85b5-52ceb57d84ce tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:55.753426 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b91a6c83-53fb-4266-85b5-52ceb57d84ce tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Going to try to terminate instance {{(pid=116788) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:41:55.976450 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b91a6c83-53fb-4266-85b5-52ceb57d84ce tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "DELETE /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 204 len: 0 microversion: 2.20 time: 0.261186 Nov 23 14:41:55.977047 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 693/1415] 10.222.0.82 () {60 vars in 1279 bytes} [Tue Nov 23 14:41:55 2021] DELETE /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 14:41:55.985513 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-263b9c00-ba2e-438d-aeaa-f539d7be6da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:55.986168 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-263b9c00-ba2e-438d-aeaa-f539d7be6da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:55.993083 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-263b9c00-ba2e-438d-aeaa-f539d7be6da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:55.993586 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-263b9c00-ba2e-438d-aeaa-f539d7be6da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:55.994452 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-263b9c00-ba2e-438d-aeaa-f539d7be6da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:55.994906 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-263b9c00-ba2e-438d-aeaa-f539d7be6da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:56.130281 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-263b9c00-ba2e-438d-aeaa-f539d7be6da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:41:56.138798 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-263b9c00-ba2e-438d-aeaa-f539d7be6da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:41:56.140287 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-263b9c00-ba2e-438d-aeaa-f539d7be6da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:41:56.141719 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-263b9c00-ba2e-438d-aeaa-f539d7be6da1 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.160007 Nov 23 14:41:56.142087 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 723/1416] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:41:55 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:41:57.162015 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7265af8c-10d1-4b62-bcd1-026895c5ca18 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:57.163343 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7265af8c-10d1-4b62-bcd1-026895c5ca18 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:57.169622 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7265af8c-10d1-4b62-bcd1-026895c5ca18 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:57.170069 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7265af8c-10d1-4b62-bcd1-026895c5ca18 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:57.170842 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7265af8c-10d1-4b62-bcd1-026895c5ca18 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:57.171275 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7265af8c-10d1-4b62-bcd1-026895c5ca18 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:57.573512 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7265af8c-10d1-4b62-bcd1-026895c5ca18 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:41:57.582145 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7265af8c-10d1-4b62-bcd1-026895c5ca18 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:41:57.583623 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7265af8c-10d1-4b62-bcd1-026895c5ca18 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:41:57.585613 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7265af8c-10d1-4b62-bcd1-026895c5ca18 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1724 microversion: 2.20 time: 0.427955 Nov 23 14:41:57.586132 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 694/1417] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:41:57 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1724 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 14:41:58.603951 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7eee88e3-2f4a-41bb-b834-6d527deb6483 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:58.604574 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7eee88e3-2f4a-41bb-b834-6d527deb6483 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:58.612507 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7eee88e3-2f4a-41bb-b834-6d527deb6483 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:58.612945 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7eee88e3-2f4a-41bb-b834-6d527deb6483 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:58.614094 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7eee88e3-2f4a-41bb-b834-6d527deb6483 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:58.614674 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-699e3150-582f-4cf1-84f8-b172d36eebf5 req-41af366b-de65-4f95-911d-4e065cd1890f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2857aac3-a684-44f3-8205-e73b0f8505ce", "name": "network-vif-deleted", "tag": "34eaa672-bc07-44f3-9bb4-56d1e4fcbcbd"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:41:58.615263 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7eee88e3-2f4a-41bb-b834-6d527deb6483 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:58.617816 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:41:58.617816 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:41:58.625569 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-699e3150-582f-4cf1-84f8-b172d36eebf5 req-41af366b-de65-4f95-911d-4e065cd1890f service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:58.626390 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-699e3150-582f-4cf1-84f8-b172d36eebf5 req-41af366b-de65-4f95-911d-4e065cd1890f service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:58.638774 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-699e3150-582f-4cf1-84f8-b172d36eebf5 req-41af366b-de65-4f95-911d-4e065cd1890f service nova] Creating event network-vif-deleted:34eaa672-bc07-44f3-9bb4-56d1e4fcbcbd for instance 2857aac3-a684-44f3-8205-e73b0f8505ce on hv-cinder-80475 Nov 23 14:41:58.643677 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-699e3150-582f-4cf1-84f8-b172d36eebf5 req-41af366b-de65-4f95-911d-4e065cd1890f service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034129 Nov 23 14:41:58.644642 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 695/1418] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:41:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:41:58.690214 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7eee88e3-2f4a-41bb-b834-6d527deb6483 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:41:58.699738 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7eee88e3-2f4a-41bb-b834-6d527deb6483 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:41:58.701429 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7eee88e3-2f4a-41bb-b834-6d527deb6483 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641f2f7ca87d4245a59f2dbe7b98759a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e139a46b8d40e4a8a321403730eb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:41:58.702823 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7eee88e3-2f4a-41bb-b834-6d527deb6483 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 200 len: 1656 microversion: 2.20 time: 0.103176 Nov 23 14:41:58.714992 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 724/1419] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:41:58 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 1656 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 14:41:59.723442 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f798e1d6-0d21-4865-abba-fe1fc0c23e17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:59.724201 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-f798e1d6-0d21-4865-abba-fe1fc0c23e17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:41:59.731205 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f798e1d6-0d21-4865-abba-fe1fc0c23e17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:59.731649 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f798e1d6-0d21-4865-abba-fe1fc0c23e17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:59.732479 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f798e1d6-0d21-4865-abba-fe1fc0c23e17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:41:59.732890 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-f798e1d6-0d21-4865-abba-fe1fc0c23e17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:41:59.747536 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-f798e1d6-0d21-4865-abba-fe1fc0c23e17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] HTTP exception thrown: Instance 2857aac3-a684-44f3-8205-e73b0f8505ce could not be found. Nov 23 14:41:59.748124 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f798e1d6-0d21-4865-abba-fe1fc0c23e17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Returning 404 to user: Instance 2857aac3-a684-44f3-8205-e73b0f8505ce could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:41:59.749015 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f798e1d6-0d21-4865-abba-fe1fc0c23e17 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 404 len: 111 microversion: 2.20 time: 0.030264 Nov 23 14:41:59.754526 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 696/1420] 10.222.0.82 () {60 vars in 1276 bytes} [Tue Nov 23 14:41:59 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 23 14:41:59.757992 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-e04b1c3d-f009-4a93-b800-6947a665ed48 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '.version_select at 0x7f20880af1f0>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:41:59.833817 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-e04b1c3d-f009-4a93-b800-6947a665ed48 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657160748" status: 204 len: 0 microversion: 2.20 time: 0.079619 Nov 23 14:41:59.834406 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 725/1421] 10.222.0.82 () {60 vars in 1261 bytes} [Tue Nov 23 14:41:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657160748 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 14:42:01.847501 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a5524871-d102-423e-be07-c2da8b94b1b9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:42:01.847982 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a5524871-d102-423e-be07-c2da8b94b1b9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:42:01.854237 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a5524871-d102-423e-be07-c2da8b94b1b9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:42:01.854674 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a5524871-d102-423e-be07-c2da8b94b1b9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:42:01.855437 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a5524871-d102-423e-be07-c2da8b94b1b9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:42:01.855866 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a5524871-d102-423e-be07-c2da8b94b1b9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:42:01.872108 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-a5524871-d102-423e-be07-c2da8b94b1b9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] HTTP exception thrown: Instance 2857aac3-a684-44f3-8205-e73b0f8505ce could not be found. Nov 23 14:42:01.872721 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a5524871-d102-423e-be07-c2da8b94b1b9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Returning 404 to user: Instance 2857aac3-a684-44f3-8205-e73b0f8505ce could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:42:01.873543 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a5524871-d102-423e-be07-c2da8b94b1b9 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "DELETE /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 404 len: 111 microversion: 2.1 time: 0.029700 Nov 23 14:42:01.874089 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 697/1422] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:42:01 2021] DELETE /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:42:01.881806 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ea256dfb-50ed-4dab-bfc5-5607d839c896 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:42:01.882420 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ea256dfb-50ed-4dab-bfc5-5607d839c896 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: 2857aac3-a684-44f3-8205-e73b0f8505ce] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:42:01.890203 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ea256dfb-50ed-4dab-bfc5-5607d839c896 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:42:01.890655 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ea256dfb-50ed-4dab-bfc5-5607d839c896 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:42:01.891433 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ea256dfb-50ed-4dab-bfc5-5607d839c896 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:42:01.891872 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ea256dfb-50ed-4dab-bfc5-5607d839c896 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:42:01.905233 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-ea256dfb-50ed-4dab-bfc5-5607d839c896 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] HTTP exception thrown: Instance 2857aac3-a684-44f3-8205-e73b0f8505ce could not be found. Nov 23 14:42:01.905806 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ea256dfb-50ed-4dab-bfc5-5607d839c896 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Returning 404 to user: Instance 2857aac3-a684-44f3-8205-e73b0f8505ce could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:42:01.906608 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ea256dfb-50ed-4dab-bfc5-5607d839c896 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce" status: 404 len: 111 microversion: 2.1 time: 0.028496 Nov 23 14:42:01.907118 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 726/1423] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:42:01 2021] GET /compute/v2.1/servers/2857aac3-a684-44f3-8205-e73b0f8505ce => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:42:03.131776 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-21ad4ca0-513d-4265-84d5-e048aaeb0da0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:42:03.132360 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-21ad4ca0-513d-4265-84d5-e048aaeb0da0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:42:03.139114 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-21ad4ca0-513d-4265-84d5-e048aaeb0da0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:42:03.139559 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-21ad4ca0-513d-4265-84d5-e048aaeb0da0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:42:03.140360 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-21ad4ca0-513d-4265-84d5-e048aaeb0da0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:42:03.140793 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-21ad4ca0-513d-4265-84d5-e048aaeb0da0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:42:03.155015 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-21ad4ca0-513d-4265-84d5-e048aaeb0da0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] HTTP exception thrown: Instance f5c8dbd0-2f80-4158-923b-24f263fd9832 could not be found. Nov 23 14:42:03.155622 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-21ad4ca0-513d-4265-84d5-e048aaeb0da0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Returning 404 to user: Instance f5c8dbd0-2f80-4158-923b-24f263fd9832 could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:42:03.156483 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-21ad4ca0-513d-4265-84d5-e048aaeb0da0 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "DELETE /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 404 len: 111 microversion: 2.1 time: 0.028334 Nov 23 14:42:03.157052 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 698/1424] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:42:03 2021] DELETE /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:42:03.164822 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1a085c6a-543a-4586-9d95-fa3a5d71fe19 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:42:03.165428 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-1a085c6a-543a-4586-9d95-fa3a5d71fe19 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] [instance: f5c8dbd0-2f80-4158-923b-24f263fd9832] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:42:03.171787 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1a085c6a-543a-4586-9d95-fa3a5d71fe19 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:42:03.172230 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1a085c6a-543a-4586-9d95-fa3a5d71fe19 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:42:03.173029 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1a085c6a-543a-4586-9d95-fa3a5d71fe19 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:42:03.173458 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-1a085c6a-543a-4586-9d95-fa3a5d71fe19 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:42:03.186166 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-1a085c6a-543a-4586-9d95-fa3a5d71fe19 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] HTTP exception thrown: Instance f5c8dbd0-2f80-4158-923b-24f263fd9832 could not be found. Nov 23 14:42:03.186728 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-1a085c6a-543a-4586-9d95-fa3a5d71fe19 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] Returning 404 to user: Instance f5c8dbd0-2f80-4158-923b-24f263fd9832 could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:42:03.187545 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-1a085c6a-543a-4586-9d95-fa3a5d71fe19 tempest-AttachVolumeShelveTestJSON-1505342641 tempest-AttachVolumeShelveTestJSON-1505342641-project] 10.222.0.82 "GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832" status: 404 len: 111 microversion: 2.1 time: 0.026415 Nov 23 14:42:03.188055 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 727/1425] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:42:03 2021] GET /compute/v2.1/servers/f5c8dbd0-2f80-4158-923b-24f263fd9832 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:42:10.678167 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:42:10.678699 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: Tue Nov 23 14:42:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:42:54.832289 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-bf61ed2b-3070-45ce-ba06-733615d1337e tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Action: 'create', calling method: .version_select at 0x7f208803a1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1535281038"}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:42:54.847853 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-bf61ed2b-3070-45ce-ba06-733615d1337e tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Getting quotas for project 15e58f0cbadf4005bbb5be04e4aef3c1. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:42:54.851858 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-bf61ed2b-3070-45ce-ba06-733615d1337e tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Getting quotas for user f8e5f3c269d4437c982a5747ddf02d71 and project 15e58f0cbadf4005bbb5be04e4aef3c1. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:42:55.186534 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-bf61ed2b-3070-45ce-ba06-733615d1337e tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Getting quotas for project 15e58f0cbadf4005bbb5be04e4aef3c1. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:42:55.191234 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-bf61ed2b-3070-45ce-ba06-733615d1337e tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Getting quotas for user f8e5f3c269d4437c982a5747ddf02d71 and project 15e58f0cbadf4005bbb5be04e4aef3c1. Resources: {'key_pairs'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:42:55.208986 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-bf61ed2b-3070-45ce-ba06-733615d1337e tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.580584 Nov 23 14:42:55.209504 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 699/1426] 10.222.0.82 () {60 vars in 1157 bytes} [Tue Nov 23 14:42:54 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:23.882382 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5ebcfe5c-7581-4f9c-af41-5ac71d0118d4] AMQP server on 10.222.0.82:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 23 14:43:23.886800 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-194496128", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1535281038", "security_groups": [{"name": "tempest-secgroup-smoke-122824768"}], "block_device_mapping_v2": [{"uuid": "e0ce0e9f-0689-430d-b4b6-3c78709d3d8c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8c2d1d31-b3ce-4eb8-82ac-9c0fcdc35f7d"}]}} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:43:23.992811 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.network.neutron [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] validate_networks() for [('8c2d1d31-b3ce-4eb8-82ac-9c0fcdc35f7d', None, None, None, None, None)] {{(pid=116787) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:43:24.548450 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Flavor limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:43:24.551882 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Image limits 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:43:24.551882 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Flavor pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:43:24.551882 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Image pref 0:0:0 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:43:24.551882 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.virt.hardware [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:43:24.559042 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:24.559526 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:24.560378 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:24.560819 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:24.577865 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Getting quotas for project 15e58f0cbadf4005bbb5be04e4aef3c1. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:43:24.582074 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.quota [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Getting quotas for user f8e5f3c269d4437c982a5747ddf02d71 and project 15e58f0cbadf4005bbb5be04e4aef3c1. Resources: {'instances', 'cores', 'ram'} {{(pid=116787) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:43:24.637310 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Going to run 1 instances... {{(pid=116787) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:43:24.639503 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0ce0e9f-0689-430d-b4b6-3c78709d3d8c',volume_size=None,volume_type=None)] {{(pid=116787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:43:24.910381 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO oslo.messaging._drivers.impl_rabbit [-] [5ebcfe5c-7581-4f9c-af41-5ac71d0118d4] Reconnected to AMQP server on 10.222.0.82:5672 via [amqp] client with port 33828. Nov 23 14:43:25.057304 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [44c9affb-556f-4212-9571-523fba948eeb] AMQP server on 10.222.0.82:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 23 14:43:26.075895 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO oslo.messaging._drivers.impl_rabbit [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [44c9affb-556f-4212-9571-523fba948eeb] Reconnected to AMQP server on 10.222.0.82:5672 via [amqp] client with port 33832. Nov 23 14:43:26.079337 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-cabc2682-3674-43bd-8eb5-759b915b6fb9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.198939 Nov 23 14:43:26.080169 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 728/1427] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:43:23 2021] POST /compute/v2.1/servers => generated 405 bytes in 2200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 14:43:26.087756 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b69cfd20-7f37-4edb-b57f-9b2891be2c86] AMQP server on 10.222.0.82:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 23 14:43:26.091399 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9171371f-f5e7-474b-b4ea-aa5ba979fd17 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:26.093561 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9171371f-f5e7-474b-b4ea-aa5ba979fd17 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:26.145813 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9171371f-f5e7-474b-b4ea-aa5ba979fd17 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:26.152415 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9171371f-f5e7-474b-b4ea-aa5ba979fd17 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1094 microversion: 2.1 time: 0.066118 Nov 23 14:43:26.153195 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 700/1428] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:26 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:27.169547 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-73d37ca6-db0e-4280-98bf-5af779f61084 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:27.170180 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-73d37ca6-db0e-4280-98bf-5af779f61084 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:27.222752 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-73d37ca6-db0e-4280-98bf-5af779f61084 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:27.229886 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-73d37ca6-db0e-4280-98bf-5af779f61084 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1094 microversion: 2.1 time: 0.064596 Nov 23 14:43:27.230485 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 729/1429] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:27 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:28.247481 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d173f72a-c259-4835-a552-9a021286b013 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:28.248081 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d173f72a-c259-4835-a552-9a021286b013 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:28.265619 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d173f72a-c259-4835-a552-9a021286b013 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:28.266069 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d173f72a-c259-4835-a552-9a021286b013 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:28.266893 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d173f72a-c259-4835-a552-9a021286b013 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:28.267325 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d173f72a-c259-4835-a552-9a021286b013 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:28.283557 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO oslo.messaging._drivers.impl_rabbit [-] [b69cfd20-7f37-4edb-b57f-9b2891be2c86] Reconnected to AMQP server on 10.222.0.82:5672 via [amqp] client with port 33856. Nov 23 14:43:28.329797 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d173f72a-c259-4835-a552-9a021286b013 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:28.337499 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d173f72a-c259-4835-a552-9a021286b013 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1200 microversion: 2.1 time: 0.094039 Nov 23 14:43:28.338054 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 701/1430] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:28 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1200 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:29.355883 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2b6a78ff-7eff-4f09-960b-a4de765d0722 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:29.356547 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2b6a78ff-7eff-4f09-960b-a4de765d0722 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:29.375564 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2b6a78ff-7eff-4f09-960b-a4de765d0722 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:29.376224 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2b6a78ff-7eff-4f09-960b-a4de765d0722 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:29.382201 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2b6a78ff-7eff-4f09-960b-a4de765d0722 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:29.382201 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2b6a78ff-7eff-4f09-960b-a4de765d0722 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:29.628087 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2b6a78ff-7eff-4f09-960b-a4de765d0722 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:29.636102 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2b6a78ff-7eff-4f09-960b-a4de765d0722 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1277 microversion: 2.1 time: 0.284811 Nov 23 14:43:29.636722 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 730/1431] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:29 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1277 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:43:30.162010 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-33476678-2b15-4218-a5a1-96f4601086cc req-6c1c2fc7-9471-4e7d-bd10-956223ff95cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37c522a6-f2da-4126-8472-c685c2422bcd", "tag": "258b7a9f-8616-4f6e-b6dc-09414d479883"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:43:30.169618 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:43:30.169618 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:43:30.171982 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-33476678-2b15-4218-a5a1-96f4601086cc req-6c1c2fc7-9471-4e7d-bd10-956223ff95cc service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:30.172460 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-33476678-2b15-4218-a5a1-96f4601086cc req-6c1c2fc7-9471-4e7d-bd10-956223ff95cc service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:30.184226 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-33476678-2b15-4218-a5a1-96f4601086cc req-6c1c2fc7-9471-4e7d-bd10-956223ff95cc service nova] Creating event network-changed:258b7a9f-8616-4f6e-b6dc-09414d479883 for instance 37c522a6-f2da-4126-8472-c685c2422bcd on hv-cinder-80475 Nov 23 14:43:30.189777 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-33476678-2b15-4218-a5a1-96f4601086cc req-6c1c2fc7-9471-4e7d-bd10-956223ff95cc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032336 Nov 23 14:43:30.190456 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 702/1432] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:43:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:43:30.652690 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2ce5cda9-dbf3-4236-8c22-38ee66dbf377 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:30.653301 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2ce5cda9-dbf3-4236-8c22-38ee66dbf377 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:30.659545 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2ce5cda9-dbf3-4236-8c22-38ee66dbf377 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:30.660297 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2ce5cda9-dbf3-4236-8c22-38ee66dbf377 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:30.661226 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2ce5cda9-dbf3-4236-8c22-38ee66dbf377 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:30.661818 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2ce5cda9-dbf3-4236-8c22-38ee66dbf377 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:30.894577 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2ce5cda9-dbf3-4236-8c22-38ee66dbf377 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:30.902545 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2ce5cda9-dbf3-4236-8c22-38ee66dbf377 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.253436 Nov 23 14:43:30.903104 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 731/1433] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:30 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:31.921291 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-435714c4-2e67-47a9-b45b-13dc374a7e56 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:31.921981 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-435714c4-2e67-47a9-b45b-13dc374a7e56 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:31.928030 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-435714c4-2e67-47a9-b45b-13dc374a7e56 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:31.928500 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-435714c4-2e67-47a9-b45b-13dc374a7e56 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:31.929915 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-435714c4-2e67-47a9-b45b-13dc374a7e56 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:31.930375 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-435714c4-2e67-47a9-b45b-13dc374a7e56 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:32.063238 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-435714c4-2e67-47a9-b45b-13dc374a7e56 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:32.071070 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-435714c4-2e67-47a9-b45b-13dc374a7e56 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.154162 Nov 23 14:43:32.071643 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 703/1434] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:31 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:33.087911 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f552bdc4-4fe0-4902-a11a-3b0a90aa5bda tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:33.088491 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f552bdc4-4fe0-4902-a11a-3b0a90aa5bda tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:33.094707 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f552bdc4-4fe0-4902-a11a-3b0a90aa5bda tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:33.095159 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f552bdc4-4fe0-4902-a11a-3b0a90aa5bda tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:33.095933 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f552bdc4-4fe0-4902-a11a-3b0a90aa5bda tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:33.096399 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f552bdc4-4fe0-4902-a11a-3b0a90aa5bda tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:33.233346 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f552bdc4-4fe0-4902-a11a-3b0a90aa5bda tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:33.240919 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f552bdc4-4fe0-4902-a11a-3b0a90aa5bda tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.156743 Nov 23 14:43:33.241483 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 732/1435] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:33 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:34.258395 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-96697425-efa2-4a40-90bd-637e60c5377d tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:34.259001 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-96697425-efa2-4a40-90bd-637e60c5377d tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:34.265408 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-96697425-efa2-4a40-90bd-637e60c5377d tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:34.265907 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-96697425-efa2-4a40-90bd-637e60c5377d tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:34.266690 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-96697425-efa2-4a40-90bd-637e60c5377d tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:34.267130 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-96697425-efa2-4a40-90bd-637e60c5377d tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:34.399403 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-96697425-efa2-4a40-90bd-637e60c5377d tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:34.406684 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-96697425-efa2-4a40-90bd-637e60c5377d tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.152116 Nov 23 14:43:34.407255 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 704/1436] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:34 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:35.423889 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c9368e75-0389-4bc4-bcdf-79b72ffb0a1c tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:35.424543 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c9368e75-0389-4bc4-bcdf-79b72ffb0a1c tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:35.431069 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c9368e75-0389-4bc4-bcdf-79b72ffb0a1c tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:35.431511 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c9368e75-0389-4bc4-bcdf-79b72ffb0a1c tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:35.432301 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c9368e75-0389-4bc4-bcdf-79b72ffb0a1c tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:35.432734 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c9368e75-0389-4bc4-bcdf-79b72ffb0a1c tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:35.573587 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c9368e75-0389-4bc4-bcdf-79b72ffb0a1c tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:35.581090 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c9368e75-0389-4bc4-bcdf-79b72ffb0a1c tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.160884 Nov 23 14:43:35.581646 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 733/1437] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:35 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:36.597691 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-54a43b3f-0695-43c1-b4ac-6b7b4a8230bb tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:36.598278 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-54a43b3f-0695-43c1-b4ac-6b7b4a8230bb tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:36.604603 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-54a43b3f-0695-43c1-b4ac-6b7b4a8230bb tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:36.605049 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-54a43b3f-0695-43c1-b4ac-6b7b4a8230bb tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:36.605830 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-54a43b3f-0695-43c1-b4ac-6b7b4a8230bb tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:36.606302 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-54a43b3f-0695-43c1-b4ac-6b7b4a8230bb tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:36.744496 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-54a43b3f-0695-43c1-b4ac-6b7b4a8230bb tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:36.752585 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-54a43b3f-0695-43c1-b4ac-6b7b4a8230bb tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.158484 Nov 23 14:43:36.753183 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 705/1438] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:36 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:37.770787 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a3955141-8a17-4fa6-bed9-c4b1d254b042 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:37.771381 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a3955141-8a17-4fa6-bed9-c4b1d254b042 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:37.778002 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a3955141-8a17-4fa6-bed9-c4b1d254b042 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:37.778444 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a3955141-8a17-4fa6-bed9-c4b1d254b042 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:37.779212 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a3955141-8a17-4fa6-bed9-c4b1d254b042 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:37.779642 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a3955141-8a17-4fa6-bed9-c4b1d254b042 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:37.909864 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a3955141-8a17-4fa6-bed9-c4b1d254b042 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:37.917538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a3955141-8a17-4fa6-bed9-c4b1d254b042 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.150482 Nov 23 14:43:37.918104 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 734/1439] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:37 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:38.934599 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-3dfeed29-9643-424f-b260-7d5809dd0d44 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:38.935202 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-3dfeed29-9643-424f-b260-7d5809dd0d44 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:38.941424 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3dfeed29-9643-424f-b260-7d5809dd0d44 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:38.941873 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3dfeed29-9643-424f-b260-7d5809dd0d44 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:38.942644 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3dfeed29-9643-424f-b260-7d5809dd0d44 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:38.943078 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-3dfeed29-9643-424f-b260-7d5809dd0d44 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:39.075504 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-3dfeed29-9643-424f-b260-7d5809dd0d44 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:39.082752 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-3dfeed29-9643-424f-b260-7d5809dd0d44 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.151978 Nov 23 14:43:39.083325 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 706/1440] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:38 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:40.099836 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-478a28d8-b0ab-40e9-a9e5-68e568945d9b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:40.100469 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-478a28d8-b0ab-40e9-a9e5-68e568945d9b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:40.107185 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-478a28d8-b0ab-40e9-a9e5-68e568945d9b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:40.107722 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-478a28d8-b0ab-40e9-a9e5-68e568945d9b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:40.108542 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-478a28d8-b0ab-40e9-a9e5-68e568945d9b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:40.108974 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-478a28d8-b0ab-40e9-a9e5-68e568945d9b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:40.244611 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-478a28d8-b0ab-40e9-a9e5-68e568945d9b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:40.252060 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-478a28d8-b0ab-40e9-a9e5-68e568945d9b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.155773 Nov 23 14:43:40.252638 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 735/1441] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:40 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:41.270021 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-0101a046-2071-413a-8838-56f98cd3512d tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:41.270629 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-0101a046-2071-413a-8838-56f98cd3512d tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:41.277444 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0101a046-2071-413a-8838-56f98cd3512d tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:41.277884 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0101a046-2071-413a-8838-56f98cd3512d tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:41.278646 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0101a046-2071-413a-8838-56f98cd3512d tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:41.279075 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-0101a046-2071-413a-8838-56f98cd3512d tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:41.409347 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-0101a046-2071-413a-8838-56f98cd3512d tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:41.416664 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-0101a046-2071-413a-8838-56f98cd3512d tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.150485 Nov 23 14:43:41.417225 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 707/1442] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:41 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:42.433728 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9a65b830-d226-4e04-b6ea-81dd38c25bb7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:42.434286 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9a65b830-d226-4e04-b6ea-81dd38c25bb7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:42.440519 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9a65b830-d226-4e04-b6ea-81dd38c25bb7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:42.440970 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9a65b830-d226-4e04-b6ea-81dd38c25bb7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:42.441742 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9a65b830-d226-4e04-b6ea-81dd38c25bb7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:42.442177 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9a65b830-d226-4e04-b6ea-81dd38c25bb7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:42.571636 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9a65b830-d226-4e04-b6ea-81dd38c25bb7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:42.578846 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9a65b830-d226-4e04-b6ea-81dd38c25bb7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.149438 Nov 23 14:43:42.579408 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 736/1443] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:42 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:43.595529 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ea954549-4c3f-4ea1-9753-9075e0d6483b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:43.596086 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ea954549-4c3f-4ea1-9753-9075e0d6483b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:43.602767 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ea954549-4c3f-4ea1-9753-9075e0d6483b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:43.603222 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ea954549-4c3f-4ea1-9753-9075e0d6483b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:43.603997 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ea954549-4c3f-4ea1-9753-9075e0d6483b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:43.604468 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ea954549-4c3f-4ea1-9753-9075e0d6483b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:43.739809 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-ea954549-4c3f-4ea1-9753-9075e0d6483b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:43.747800 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ea954549-4c3f-4ea1-9753-9075e0d6483b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.156040 Nov 23 14:43:43.748560 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 708/1444] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:43 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:44.765490 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-4848eb41-7a35-49eb-bb1f-ab625c1210d8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:44.766102 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-4848eb41-7a35-49eb-bb1f-ab625c1210d8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:44.772365 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4848eb41-7a35-49eb-bb1f-ab625c1210d8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:44.772835 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4848eb41-7a35-49eb-bb1f-ab625c1210d8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:44.773607 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4848eb41-7a35-49eb-bb1f-ab625c1210d8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:44.774044 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-4848eb41-7a35-49eb-bb1f-ab625c1210d8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:44.911979 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-4848eb41-7a35-49eb-bb1f-ab625c1210d8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:44.919385 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-4848eb41-7a35-49eb-bb1f-ab625c1210d8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.157479 Nov 23 14:43:44.919970 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 737/1445] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:44 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:45.937093 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-508a1168-821b-4e62-b98f-06135f734be5 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:45.938653 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-508a1168-821b-4e62-b98f-06135f734be5 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:45.945118 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-508a1168-821b-4e62-b98f-06135f734be5 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:45.945560 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-508a1168-821b-4e62-b98f-06135f734be5 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:45.946901 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-508a1168-821b-4e62-b98f-06135f734be5 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:45.947363 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-508a1168-821b-4e62-b98f-06135f734be5 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:46.080115 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-508a1168-821b-4e62-b98f-06135f734be5 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:46.088533 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-508a1168-821b-4e62-b98f-06135f734be5 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.155876 Nov 23 14:43:46.091151 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 709/1446] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:45 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:46.128357 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-80421af3-2196-42a2-8d4d-986245bb65f9 req-85decfd5-efe5-454e-a800-5ead79b67280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c522a6-f2da-4126-8472-c685c2422bcd", "name": "network-vif-plugged", "status": "completed", "tag": "258b7a9f-8616-4f6e-b6dc-09414d479883"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:43:46.130059 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:43:46.130059 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:43:46.137967 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-80421af3-2196-42a2-8d4d-986245bb65f9 req-85decfd5-efe5-454e-a800-5ead79b67280 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:46.138538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-80421af3-2196-42a2-8d4d-986245bb65f9 req-85decfd5-efe5-454e-a800-5ead79b67280 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:46.149913 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-80421af3-2196-42a2-8d4d-986245bb65f9 req-85decfd5-efe5-454e-a800-5ead79b67280 service nova] Creating event network-vif-plugged:258b7a9f-8616-4f6e-b6dc-09414d479883 for instance 37c522a6-f2da-4126-8472-c685c2422bcd on hv-cinder-80475 Nov 23 14:43:46.155824 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-80421af3-2196-42a2-8d4d-986245bb65f9 req-85decfd5-efe5-454e-a800-5ead79b67280 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150531 Nov 23 14:43:46.156437 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 738/1447] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:43:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:43:47.105278 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-6e6d9dbb-7124-4eeb-bc21-672d65c042df tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:47.105888 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-6e6d9dbb-7124-4eeb-bc21-672d65c042df tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:47.112119 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6e6d9dbb-7124-4eeb-bc21-672d65c042df tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:47.112597 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6e6d9dbb-7124-4eeb-bc21-672d65c042df tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:47.113368 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6e6d9dbb-7124-4eeb-bc21-672d65c042df tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:47.113800 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-6e6d9dbb-7124-4eeb-bc21-672d65c042df tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:47.245304 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-6e6d9dbb-7124-4eeb-bc21-672d65c042df tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:47.252681 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-6e6d9dbb-7124-4eeb-bc21-672d65c042df tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.151340 Nov 23 14:43:47.253244 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 710/1448] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:47 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:48.270477 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-628e54c3-77ef-4120-8e25-4fa7592be693 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:48.271086 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-628e54c3-77ef-4120-8e25-4fa7592be693 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:48.278279 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-628e54c3-77ef-4120-8e25-4fa7592be693 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:48.278722 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-628e54c3-77ef-4120-8e25-4fa7592be693 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:48.279493 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-628e54c3-77ef-4120-8e25-4fa7592be693 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:48.279921 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-628e54c3-77ef-4120-8e25-4fa7592be693 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:48.410872 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-628e54c3-77ef-4120-8e25-4fa7592be693 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:48.418793 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-628e54c3-77ef-4120-8e25-4fa7592be693 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.152409 Nov 23 14:43:48.419345 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 739/1449] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:48 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:49.435947 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a7bd5792-cad7-4a8f-b1ec-3bacb260fdbf tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:49.436579 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a7bd5792-cad7-4a8f-b1ec-3bacb260fdbf tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:49.442910 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a7bd5792-cad7-4a8f-b1ec-3bacb260fdbf tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:49.443360 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a7bd5792-cad7-4a8f-b1ec-3bacb260fdbf tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:49.444135 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a7bd5792-cad7-4a8f-b1ec-3bacb260fdbf tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:49.444603 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a7bd5792-cad7-4a8f-b1ec-3bacb260fdbf tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:49.576160 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a7bd5792-cad7-4a8f-b1ec-3bacb260fdbf tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:49.583456 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a7bd5792-cad7-4a8f-b1ec-3bacb260fdbf tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.151208 Nov 23 14:43:49.584015 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 711/1450] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:49 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:50.600960 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-399d7a32-dd97-45b6-a4a0-235542220ff7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:50.601562 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-399d7a32-dd97-45b6-a4a0-235542220ff7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:50.608095 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-399d7a32-dd97-45b6-a4a0-235542220ff7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:50.608597 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-399d7a32-dd97-45b6-a4a0-235542220ff7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:50.609363 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-399d7a32-dd97-45b6-a4a0-235542220ff7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:50.609793 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-399d7a32-dd97-45b6-a4a0-235542220ff7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:50.744626 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-399d7a32-dd97-45b6-a4a0-235542220ff7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:50.752575 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-399d7a32-dd97-45b6-a4a0-235542220ff7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1265 microversion: 2.1 time: 0.155224 Nov 23 14:43:50.753138 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 740/1451] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:50 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:51.769317 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-b0bfee56-e279-48b3-aca8-624ec0a3477b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:51.769927 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-b0bfee56-e279-48b3-aca8-624ec0a3477b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:51.777099 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b0bfee56-e279-48b3-aca8-624ec0a3477b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:51.777539 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b0bfee56-e279-48b3-aca8-624ec0a3477b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:51.778307 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b0bfee56-e279-48b3-aca8-624ec0a3477b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:51.778738 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-b0bfee56-e279-48b3-aca8-624ec0a3477b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:51.908511 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-b0bfee56-e279-48b3-aca8-624ec0a3477b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:51.915868 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-b0bfee56-e279-48b3-aca8-624ec0a3477b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1453 microversion: 2.1 time: 0.150290 Nov 23 14:43:51.916445 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 712/1452] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:51 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:51.932104 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6f226730-d455-4a20-9840-01ac2aca6c7a tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:43:51.932736 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6f226730-d455-4a20-9840-01ac2aca6c7a tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:43:51.938982 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6f226730-d455-4a20-9840-01ac2aca6c7a tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:51.939434 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6f226730-d455-4a20-9840-01ac2aca6c7a tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:51.940216 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6f226730-d455-4a20-9840-01ac2aca6c7a tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:51.940680 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6f226730-d455-4a20-9840-01ac2aca6c7a tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:52.073072 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6f226730-d455-4a20-9840-01ac2aca6c7a tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:43:52.080327 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6f226730-d455-4a20-9840-01ac2aca6c7a tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1453 microversion: 2.1 time: 0.152330 Nov 23 14:43:52.080896 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 741/1453] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:43:51 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:43:54.121297 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-9a1c2a19-dde0-45b3-a373-4be8ba96e82b req-6758a3fc-4572-47b0-9ed5-2dc4056d789e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37c522a6-f2da-4126-8472-c685c2422bcd", "tag": "258b7a9f-8616-4f6e-b6dc-09414d479883"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:43:54.123377 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:43:54.123377 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:43:54.130569 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-9a1c2a19-dde0-45b3-a373-4be8ba96e82b req-6758a3fc-4572-47b0-9ed5-2dc4056d789e service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:43:54.131011 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-9a1c2a19-dde0-45b3-a373-4be8ba96e82b req-6758a3fc-4572-47b0-9ed5-2dc4056d789e service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:43:54.142511 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-9a1c2a19-dde0-45b3-a373-4be8ba96e82b req-6758a3fc-4572-47b0-9ed5-2dc4056d789e service nova] Creating event network-changed:258b7a9f-8616-4f6e-b6dc-09414d479883 for instance 37c522a6-f2da-4126-8472-c685c2422bcd on hv-cinder-80475 Nov 23 14:43:54.147534 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-9a1c2a19-dde0-45b3-a373-4be8ba96e82b req-6758a3fc-4572-47b0-9ed5-2dc4056d789e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030416 Nov 23 14:43:54.148136 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 713/1454] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:43:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:45:30.695153 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:45:30.695798 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: Tue Nov 23 14:45:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:45:32.407383 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:45:32.407948 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: Tue Nov 23 14:45:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:45:53.760583 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:45:53.761203 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: Tue Nov 23 14:45:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:46:08.483296 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-b23bf75e-f373-43a9-b2eb-044ebc9bb3ec tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:08.483928 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b23bf75e-f373-43a9-b2eb-044ebc9bb3ec tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:08.489937 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b23bf75e-f373-43a9-b2eb-044ebc9bb3ec tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:08.490384 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b23bf75e-f373-43a9-b2eb-044ebc9bb3ec tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:08.491158 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b23bf75e-f373-43a9-b2eb-044ebc9bb3ec tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:08.491592 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-b23bf75e-f373-43a9-b2eb-044ebc9bb3ec tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:08.516900 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-b23bf75e-f373-43a9-b2eb-044ebc9bb3ec tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Going to try to terminate instance {{(pid=116787) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:46:08.818500 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-b23bf75e-f373-43a9-b2eb-044ebc9bb3ec tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "DELETE /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 204 len: 0 microversion: 2.1 time: 0.339933 Nov 23 14:46:08.819087 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 742/1455] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:46:08 2021] DELETE /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 14:46:08.826881 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b69cfd20-7f37-4edb-b57f-9b2891be2c86] AMQP server on 10.222.0.82:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 23 14:46:08.831187 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-91ad26ef-7004-4164-baae-9dae97b9d8d2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:08.831716 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-91ad26ef-7004-4164-baae-9dae97b9d8d2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:08.837985 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-91ad26ef-7004-4164-baae-9dae97b9d8d2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:08.838434 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-91ad26ef-7004-4164-baae-9dae97b9d8d2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:08.839209 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-91ad26ef-7004-4164-baae-9dae97b9d8d2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:08.839648 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-91ad26ef-7004-4164-baae-9dae97b9d8d2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:09.113297 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-91ad26ef-7004-4164-baae-9dae97b9d8d2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:09.120826 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-91ad26ef-7004-4164-baae-9dae97b9d8d2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1578 microversion: 2.1 time: 0.297010 Nov 23 14:46:09.121377 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 714/1456] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:08 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1578 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:10.138595 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9f8d76fc-2d15-40ea-9b17-0fb0487e771b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:10.139290 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9f8d76fc-2d15-40ea-9b17-0fb0487e771b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:10.145768 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9f8d76fc-2d15-40ea-9b17-0fb0487e771b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:10.146209 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9f8d76fc-2d15-40ea-9b17-0fb0487e771b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:10.147005 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9f8d76fc-2d15-40ea-9b17-0fb0487e771b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:10.147528 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9f8d76fc-2d15-40ea-9b17-0fb0487e771b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:10.336830 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9f8d76fc-2d15-40ea-9b17-0fb0487e771b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:10.344718 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9f8d76fc-2d15-40ea-9b17-0fb0487e771b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1578 microversion: 2.1 time: 0.210343 Nov 23 14:46:10.345281 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 743/1457] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:10 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1578 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:11.362710 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1c31cd01-f950-4af4-a44f-0eb90d074553 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:11.363588 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1c31cd01-f950-4af4-a44f-0eb90d074553 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:11.381217 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1c31cd01-f950-4af4-a44f-0eb90d074553 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:11.381660 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1c31cd01-f950-4af4-a44f-0eb90d074553 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:11.382446 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1c31cd01-f950-4af4-a44f-0eb90d074553 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:11.382905 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1c31cd01-f950-4af4-a44f-0eb90d074553 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:11.402711 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO oslo.messaging._drivers.impl_rabbit [-] [b69cfd20-7f37-4edb-b57f-9b2891be2c86] Reconnected to AMQP server on 10.222.0.82:5672 via [amqp] client with port 34126. Nov 23 14:46:11.450305 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1c31cd01-f950-4af4-a44f-0eb90d074553 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:11.458331 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1c31cd01-f950-4af4-a44f-0eb90d074553 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1511 microversion: 2.1 time: 0.099194 Nov 23 14:46:11.468202 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 715/1458] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:11 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1511 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:11.509582 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-054c8677-129d-4f48-b865-023e089b9b36 req-bd6fd975-d5e5-4adf-9a6f-c0e7d7d444a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c522a6-f2da-4126-8472-c685c2422bcd", "name": "network-vif-deleted", "tag": "258b7a9f-8616-4f6e-b6dc-09414d479883"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:46:11.511602 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:46:11.511602 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:46:11.518558 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-054c8677-129d-4f48-b865-023e089b9b36 req-bd6fd975-d5e5-4adf-9a6f-c0e7d7d444a6 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:11.519336 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-054c8677-129d-4f48-b865-023e089b9b36 req-bd6fd975-d5e5-4adf-9a6f-c0e7d7d444a6 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:11.533223 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-054c8677-129d-4f48-b865-023e089b9b36 req-bd6fd975-d5e5-4adf-9a6f-c0e7d7d444a6 service nova] Creating event network-vif-deleted:258b7a9f-8616-4f6e-b6dc-09414d479883 for instance 37c522a6-f2da-4126-8472-c685c2422bcd on hv-cinder-80475 Nov 23 14:46:11.537335 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-054c8677-129d-4f48-b865-023e089b9b36 req-bd6fd975-d5e5-4adf-9a6f-c0e7d7d444a6 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094413 Nov 23 14:46:11.538028 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 744/1459] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:46:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:46:12.474866 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-79f2ec58-5904-43d0-9542-e8ee1f052806 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:12.475495 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-79f2ec58-5904-43d0-9542-e8ee1f052806 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:12.482110 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-79f2ec58-5904-43d0-9542-e8ee1f052806 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:12.485833 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-79f2ec58-5904-43d0-9542-e8ee1f052806 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:12.485833 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-79f2ec58-5904-43d0-9542-e8ee1f052806 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:12.485833 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-79f2ec58-5904-43d0-9542-e8ee1f052806 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:12.514527 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-79f2ec58-5904-43d0-9542-e8ee1f052806 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:12.514967 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-79f2ec58-5904-43d0-9542-e8ee1f052806 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:12.515405 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.objects.instance [None req-79f2ec58-5904-43d0-9542-e8ee1f052806 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lazy-loading 'fault' on Instance uuid 37c522a6-f2da-4126-8472-c685c2422bcd {{(pid=116788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:46:12.559542 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-79f2ec58-5904-43d0-9542-e8ee1f052806 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:12.567494 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-79f2ec58-5904-43d0-9542-e8ee1f052806 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 200 len: 1230 microversion: 2.1 time: 0.096372 Nov 23 14:46:12.568049 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 716/1460] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:12 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:13.586103 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ebb2cd7e-13b0-4993-bf0c-23a12ad897e2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:13.586799 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-ebb2cd7e-13b0-4993-bf0c-23a12ad897e2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:13.593453 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ebb2cd7e-13b0-4993-bf0c-23a12ad897e2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:13.593904 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ebb2cd7e-13b0-4993-bf0c-23a12ad897e2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:13.594680 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ebb2cd7e-13b0-4993-bf0c-23a12ad897e2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:13.595119 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-ebb2cd7e-13b0-4993-bf0c-23a12ad897e2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:13.608148 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-ebb2cd7e-13b0-4993-bf0c-23a12ad897e2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] HTTP exception thrown: Instance 37c522a6-f2da-4126-8472-c685c2422bcd could not be found. Nov 23 14:46:13.608750 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-ebb2cd7e-13b0-4993-bf0c-23a12ad897e2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Returning 404 to user: Instance 37c522a6-f2da-4126-8472-c685c2422bcd could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:46:13.609560 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-ebb2cd7e-13b0-4993-bf0c-23a12ad897e2 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 404 len: 111 microversion: 2.1 time: 0.028061 Nov 23 14:46:13.610080 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 745/1461] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:13 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:46:13.701365 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-4be65702-ac60-4df5-bc3c-122ba4acd0a6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2065030772", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1535281038", "security_groups": [{"name": "tempest-secgroup-smoke-122824768"}], "block_device_mapping_v2": [{"uuid": "e0ce0e9f-0689-430d-b4b6-3c78709d3d8c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8c2d1d31-b3ce-4eb8-82ac-9c0fcdc35f7d"}]}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:46:13.809160 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.network.neutron [None req-4be65702-ac60-4df5-bc3c-122ba4acd0a6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] validate_networks() for [('8c2d1d31-b3ce-4eb8-82ac-9c0fcdc35f7d', None, None, None, None, None)] {{(pid=116788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:46:14.221905 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-4be65702-ac60-4df5-bc3c-122ba4acd0a6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Flavor limits 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:46:14.222325 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-4be65702-ac60-4df5-bc3c-122ba4acd0a6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Image limits 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:46:14.222835 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-4be65702-ac60-4df5-bc3c-122ba4acd0a6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Flavor pref 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:46:14.223235 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-4be65702-ac60-4df5-bc3c-122ba4acd0a6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Image pref 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:46:14.223664 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-4be65702-ac60-4df5-bc3c-122ba4acd0a6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:46:14.232365 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4be65702-ac60-4df5-bc3c-122ba4acd0a6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:14.232809 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4be65702-ac60-4df5-bc3c-122ba4acd0a6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:14.233603 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4be65702-ac60-4df5-bc3c-122ba4acd0a6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:14.234030 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4be65702-ac60-4df5-bc3c-122ba4acd0a6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:14.250451 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-4be65702-ac60-4df5-bc3c-122ba4acd0a6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Getting quotas for project 15e58f0cbadf4005bbb5be04e4aef3c1. Resources: {'instances', 'cores', 'ram'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:46:14.254261 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-4be65702-ac60-4df5-bc3c-122ba4acd0a6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Getting quotas for user f8e5f3c269d4437c982a5747ddf02d71 and project 15e58f0cbadf4005bbb5be04e4aef3c1. Resources: {'instances', 'cores', 'ram'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:46:14.309216 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-4be65702-ac60-4df5-bc3c-122ba4acd0a6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Going to run 1 instances... {{(pid=116788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:46:14.315773 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-4be65702-ac60-4df5-bc3c-122ba4acd0a6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0ce0e9f-0689-430d-b4b6-3c78709d3d8c',volume_size=None,volume_type=None)] {{(pid=116788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:46:14.716150 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-4be65702-ac60-4df5-bc3c-122ba4acd0a6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.018908 Nov 23 14:46:14.717208 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 717/1462] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:46:13 2021] POST /compute/v2.1/servers => generated 405 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 14:46:14.726558 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-cf618ab6-8313-42cb-a9b3-d3171cf87d7f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:14.727194 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-cf618ab6-8313-42cb-a9b3-d3171cf87d7f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:14.785655 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-cf618ab6-8313-42cb-a9b3-d3171cf87d7f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:14.792857 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-cf618ab6-8313-42cb-a9b3-d3171cf87d7f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1095 microversion: 2.1 time: 0.069953 Nov 23 14:46:14.793485 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 746/1463] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:14 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:15.810213 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d4e95d95-947e-4e36-858a-a56c4b562811 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:15.810826 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d4e95d95-947e-4e36-858a-a56c4b562811 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:15.817236 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d4e95d95-947e-4e36-858a-a56c4b562811 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:15.818820 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d4e95d95-947e-4e36-858a-a56c4b562811 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:15.818820 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d4e95d95-947e-4e36-858a-a56c4b562811 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:15.819027 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d4e95d95-947e-4e36-858a-a56c4b562811 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:15.878950 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d4e95d95-947e-4e36-858a-a56c4b562811 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:15.886325 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d4e95d95-947e-4e36-858a-a56c4b562811 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1145 microversion: 2.1 time: 0.080482 Nov 23 14:46:15.886885 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 718/1464] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:15 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:16.903092 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-f6b3f4a7-c73e-4419-ad0a-d03e93b810aa tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:16.904999 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-f6b3f4a7-c73e-4419-ad0a-d03e93b810aa tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:16.912560 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f6b3f4a7-c73e-4419-ad0a-d03e93b810aa tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:16.913089 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f6b3f4a7-c73e-4419-ad0a-d03e93b810aa tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:16.913946 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f6b3f4a7-c73e-4419-ad0a-d03e93b810aa tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:16.914453 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-f6b3f4a7-c73e-4419-ad0a-d03e93b810aa tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:16.992297 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-f6b3f4a7-c73e-4419-ad0a-d03e93b810aa tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:17.000427 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-f6b3f4a7-c73e-4419-ad0a-d03e93b810aa tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1211 microversion: 2.1 time: 0.101510 Nov 23 14:46:17.001086 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 747/1465] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:16 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1211 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:18.018032 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-7987214b-f10c-4db1-834e-d493fba8ec45 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:18.025307 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-7987214b-f10c-4db1-834e-d493fba8ec45 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:18.025307 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7987214b-f10c-4db1-834e-d493fba8ec45 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:18.025877 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7987214b-f10c-4db1-834e-d493fba8ec45 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:18.026999 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7987214b-f10c-4db1-834e-d493fba8ec45 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:18.027326 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-7987214b-f10c-4db1-834e-d493fba8ec45 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:18.173040 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-7987214b-f10c-4db1-834e-d493fba8ec45 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:18.180357 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-7987214b-f10c-4db1-834e-d493fba8ec45 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1278 microversion: 2.1 time: 0.166046 Nov 23 14:46:18.180912 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 719/1466] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:18 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:18.249043 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-d3b95219-fc6e-44ab-89c2-0f625208991c req-965c083d-02c9-4c4c-a12e-8bbedb2415c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883242e8-f865-41ca-a803-afeb0ebee9ba", "tag": "bd50e621-1d11-484e-b5cb-f16f6dd33499"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:46:18.253946 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:46:18.253946 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:46:18.258343 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-d3b95219-fc6e-44ab-89c2-0f625208991c req-965c083d-02c9-4c4c-a12e-8bbedb2415c6 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:18.258738 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-d3b95219-fc6e-44ab-89c2-0f625208991c req-965c083d-02c9-4c4c-a12e-8bbedb2415c6 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:18.270731 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-d3b95219-fc6e-44ab-89c2-0f625208991c req-965c083d-02c9-4c4c-a12e-8bbedb2415c6 service nova] Creating event network-changed:bd50e621-1d11-484e-b5cb-f16f6dd33499 for instance 883242e8-f865-41ca-a803-afeb0ebee9ba on hv-cinder-80475 Nov 23 14:46:18.275812 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-d3b95219-fc6e-44ab-89c2-0f625208991c req-965c083d-02c9-4c4c-a12e-8bbedb2415c6 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031863 Nov 23 14:46:18.276556 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 748/1467] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:46:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:46:19.197263 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1eb81f79-6308-4e48-a077-9637431dccdb tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:19.197856 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1eb81f79-6308-4e48-a077-9637431dccdb tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:19.204439 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1eb81f79-6308-4e48-a077-9637431dccdb tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:19.204881 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1eb81f79-6308-4e48-a077-9637431dccdb tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:19.205643 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1eb81f79-6308-4e48-a077-9637431dccdb tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:19.206073 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1eb81f79-6308-4e48-a077-9637431dccdb tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:19.338283 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1eb81f79-6308-4e48-a077-9637431dccdb tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:19.345548 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1eb81f79-6308-4e48-a077-9637431dccdb tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1266 microversion: 2.1 time: 0.151943 Nov 23 14:46:19.346113 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 720/1468] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:19 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:20.363944 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9ae53ea4-89f3-4821-921f-7ce3f98f18fd tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:20.364662 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9ae53ea4-89f3-4821-921f-7ce3f98f18fd tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:20.371323 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9ae53ea4-89f3-4821-921f-7ce3f98f18fd tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:20.371773 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9ae53ea4-89f3-4821-921f-7ce3f98f18fd tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:20.372618 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9ae53ea4-89f3-4821-921f-7ce3f98f18fd tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:20.373059 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9ae53ea4-89f3-4821-921f-7ce3f98f18fd tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:20.504313 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9ae53ea4-89f3-4821-921f-7ce3f98f18fd tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:20.512860 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9ae53ea4-89f3-4821-921f-7ce3f98f18fd tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1266 microversion: 2.1 time: 0.153651 Nov 23 14:46:20.513477 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 749/1469] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:20 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:21.530979 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1ea6b389-29e9-410c-9889-26f32d578b96 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:21.531584 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1ea6b389-29e9-410c-9889-26f32d578b96 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:21.537856 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1ea6b389-29e9-410c-9889-26f32d578b96 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:21.538294 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1ea6b389-29e9-410c-9889-26f32d578b96 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:21.539055 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1ea6b389-29e9-410c-9889-26f32d578b96 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:21.539484 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1ea6b389-29e9-410c-9889-26f32d578b96 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:21.669461 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1ea6b389-29e9-410c-9889-26f32d578b96 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:21.676606 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1ea6b389-29e9-410c-9889-26f32d578b96 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1266 microversion: 2.1 time: 0.149933 Nov 23 14:46:21.677163 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 721/1470] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:21 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:22.693349 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-5c20393b-0939-4805-875e-b191af81b755 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:22.693961 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-5c20393b-0939-4805-875e-b191af81b755 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:22.700856 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5c20393b-0939-4805-875e-b191af81b755 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:22.701306 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5c20393b-0939-4805-875e-b191af81b755 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:22.702078 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5c20393b-0939-4805-875e-b191af81b755 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:22.702513 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-5c20393b-0939-4805-875e-b191af81b755 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:22.833774 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-5c20393b-0939-4805-875e-b191af81b755 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:22.840890 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-5c20393b-0939-4805-875e-b191af81b755 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1266 microversion: 2.1 time: 0.151177 Nov 23 14:46:22.841449 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 750/1471] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:22 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:46:23.857013 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-272e7aef-70ca-484e-a235-7edf6213a4ef tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:23.857599 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-272e7aef-70ca-484e-a235-7edf6213a4ef tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:23.864040 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-272e7aef-70ca-484e-a235-7edf6213a4ef tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:23.864516 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-272e7aef-70ca-484e-a235-7edf6213a4ef tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:23.865279 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-272e7aef-70ca-484e-a235-7edf6213a4ef tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:23.865707 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-272e7aef-70ca-484e-a235-7edf6213a4ef tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:23.999875 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-272e7aef-70ca-484e-a235-7edf6213a4ef tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:24.007233 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-272e7aef-70ca-484e-a235-7edf6213a4ef tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1266 microversion: 2.1 time: 0.153834 Nov 23 14:46:24.007798 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 722/1472] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:23 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:46:25.024669 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-84799492-2fc9-421c-b2c6-76cffe82564f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:25.025316 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-84799492-2fc9-421c-b2c6-76cffe82564f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:25.032005 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84799492-2fc9-421c-b2c6-76cffe82564f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:25.032491 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84799492-2fc9-421c-b2c6-76cffe82564f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:25.033274 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84799492-2fc9-421c-b2c6-76cffe82564f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:25.033747 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84799492-2fc9-421c-b2c6-76cffe82564f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:25.162706 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-84799492-2fc9-421c-b2c6-76cffe82564f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:25.170050 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-84799492-2fc9-421c-b2c6-76cffe82564f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1266 microversion: 2.1 time: 0.149043 Nov 23 14:46:25.170626 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 751/1473] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:25 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:26.186593 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e4f030fe-ea11-41fe-b1de-c15a86e8e28f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:26.187245 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e4f030fe-ea11-41fe-b1de-c15a86e8e28f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:26.193580 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e4f030fe-ea11-41fe-b1de-c15a86e8e28f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:26.194033 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e4f030fe-ea11-41fe-b1de-c15a86e8e28f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:26.194851 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e4f030fe-ea11-41fe-b1de-c15a86e8e28f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:26.195249 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e4f030fe-ea11-41fe-b1de-c15a86e8e28f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:26.327470 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e4f030fe-ea11-41fe-b1de-c15a86e8e28f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:26.334770 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e4f030fe-ea11-41fe-b1de-c15a86e8e28f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1266 microversion: 2.1 time: 0.151870 Nov 23 14:46:26.335332 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 723/1474] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:26 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:27.352188 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-42c5666f-e0e0-4e85-9370-9a5a55270f00 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:27.352772 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-42c5666f-e0e0-4e85-9370-9a5a55270f00 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:27.359432 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-42c5666f-e0e0-4e85-9370-9a5a55270f00 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:27.359875 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-42c5666f-e0e0-4e85-9370-9a5a55270f00 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:27.360673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-42c5666f-e0e0-4e85-9370-9a5a55270f00 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:27.361104 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-42c5666f-e0e0-4e85-9370-9a5a55270f00 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:27.493894 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-42c5666f-e0e0-4e85-9370-9a5a55270f00 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:27.501795 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-42c5666f-e0e0-4e85-9370-9a5a55270f00 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1266 microversion: 2.1 time: 0.153432 Nov 23 14:46:27.502351 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 752/1475] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:27 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:28.518389 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-4ef99135-a937-487b-918a-cf2d9d762bd8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:28.518993 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-4ef99135-a937-487b-918a-cf2d9d762bd8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:28.525160 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4ef99135-a937-487b-918a-cf2d9d762bd8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:28.525614 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4ef99135-a937-487b-918a-cf2d9d762bd8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:28.526389 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4ef99135-a937-487b-918a-cf2d9d762bd8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:28.527051 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-4ef99135-a937-487b-918a-cf2d9d762bd8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:28.664052 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-4ef99135-a937-487b-918a-cf2d9d762bd8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:28.671549 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-4ef99135-a937-487b-918a-cf2d9d762bd8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1266 microversion: 2.1 time: 0.156819 Nov 23 14:46:28.672340 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 724/1476] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:28 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:28.718117 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-9044a8c0-1f69-4e30-a6f6-869b0f5ef83a req-c29cedab-c89e-43cf-b275-a440b1b235ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883242e8-f865-41ca-a803-afeb0ebee9ba", "name": "network-vif-plugged", "status": "completed", "tag": "bd50e621-1d11-484e-b5cb-f16f6dd33499"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:46:28.719620 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:46:28.719620 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:46:28.726812 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-9044a8c0-1f69-4e30-a6f6-869b0f5ef83a req-c29cedab-c89e-43cf-b275-a440b1b235ca service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:28.727471 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-9044a8c0-1f69-4e30-a6f6-869b0f5ef83a req-c29cedab-c89e-43cf-b275-a440b1b235ca service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:28.738411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-9044a8c0-1f69-4e30-a6f6-869b0f5ef83a req-c29cedab-c89e-43cf-b275-a440b1b235ca service nova] Creating event network-vif-plugged:bd50e621-1d11-484e-b5cb-f16f6dd33499 for instance 883242e8-f865-41ca-a803-afeb0ebee9ba on hv-cinder-80475 Nov 23 14:46:28.743352 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-9044a8c0-1f69-4e30-a6f6-869b0f5ef83a req-c29cedab-c89e-43cf-b275-a440b1b235ca service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028883 Nov 23 14:46:28.743932 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 753/1477] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:46:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:46:29.688149 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5f36ce0b-f63c-4a86-8c25-0ece4d3201ac tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:29.688784 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5f36ce0b-f63c-4a86-8c25-0ece4d3201ac tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:29.695064 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5f36ce0b-f63c-4a86-8c25-0ece4d3201ac tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:29.695504 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5f36ce0b-f63c-4a86-8c25-0ece4d3201ac tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:29.696295 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5f36ce0b-f63c-4a86-8c25-0ece4d3201ac tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:29.696728 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5f36ce0b-f63c-4a86-8c25-0ece4d3201ac tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:29.827174 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5f36ce0b-f63c-4a86-8c25-0ece4d3201ac tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:29.834399 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5f36ce0b-f63c-4a86-8c25-0ece4d3201ac tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1266 microversion: 2.1 time: 0.149951 Nov 23 14:46:29.834959 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 725/1478] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:29 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:30.852965 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-01672f4d-aa5b-4bdd-bc05-fde151883572 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:30.853661 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-01672f4d-aa5b-4bdd-bc05-fde151883572 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:30.860367 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-01672f4d-aa5b-4bdd-bc05-fde151883572 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:30.860819 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-01672f4d-aa5b-4bdd-bc05-fde151883572 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:30.861592 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-01672f4d-aa5b-4bdd-bc05-fde151883572 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:30.862030 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-01672f4d-aa5b-4bdd-bc05-fde151883572 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:30.994154 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-01672f4d-aa5b-4bdd-bc05-fde151883572 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:31.001435 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-01672f4d-aa5b-4bdd-bc05-fde151883572 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1454 microversion: 2.1 time: 0.153033 Nov 23 14:46:31.001993 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 754/1479] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:30 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:46:31.017627 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-42b58672-1c54-45e3-94e2-c9bba8a8fe12 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:46:31.020628 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-42b58672-1c54-45e3-94e2-c9bba8a8fe12 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:46:31.024330 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-42b58672-1c54-45e3-94e2-c9bba8a8fe12 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:31.024771 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-42b58672-1c54-45e3-94e2-c9bba8a8fe12 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:31.025538 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-42b58672-1c54-45e3-94e2-c9bba8a8fe12 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:31.025964 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-42b58672-1c54-45e3-94e2-c9bba8a8fe12 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:31.157695 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-42b58672-1c54-45e3-94e2-c9bba8a8fe12 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:46:31.165051 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-42b58672-1c54-45e3-94e2-c9bba8a8fe12 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1454 microversion: 2.1 time: 0.151038 Nov 23 14:46:31.165619 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 726/1480] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:46:31 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:46:33.171150 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-719d94bd-6b8e-43d4-8f13-4150149a4b67 req-4d02bbb3-7302-42e1-a294-b9565a5e09f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883242e8-f865-41ca-a803-afeb0ebee9ba", "tag": "bd50e621-1d11-484e-b5cb-f16f6dd33499"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:46:33.172697 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:46:33.172697 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:46:33.179267 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-719d94bd-6b8e-43d4-8f13-4150149a4b67 req-4d02bbb3-7302-42e1-a294-b9565a5e09f7 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:46:33.179709 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-719d94bd-6b8e-43d4-8f13-4150149a4b67 req-4d02bbb3-7302-42e1-a294-b9565a5e09f7 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:46:33.190857 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-719d94bd-6b8e-43d4-8f13-4150149a4b67 req-4d02bbb3-7302-42e1-a294-b9565a5e09f7 service nova] Creating event network-changed:bd50e621-1d11-484e-b5cb-f16f6dd33499 for instance 883242e8-f865-41ca-a803-afeb0ebee9ba on hv-cinder-80475 Nov 23 14:46:33.195923 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-719d94bd-6b8e-43d4-8f13-4150149a4b67 req-4d02bbb3-7302-42e1-a294-b9565a5e09f7 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084633 Nov 23 14:46:33.196842 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 755/1481] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:46:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:47:12.148977 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:47:12.149695 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: Tue Nov 23 14:47:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:48:38.712793 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:48:38.713385 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: Tue Nov 23 14:48:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:48:46.964743 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-250339805", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1535281038", "security_groups": [{"name": "tempest-secgroup-smoke-122824768"}], "block_device_mapping_v2": [{"uuid": "ef0d0596-85d5-46aa-abb0-6ad6319c1a24", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8c2d1d31-b3ce-4eb8-82ac-9c0fcdc35f7d"}]}} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:48:47.071327 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.network.neutron [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] validate_networks() for [('8c2d1d31-b3ce-4eb8-82ac-9c0fcdc35f7d', None, None, None, None, None)] {{(pid=116788) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 14:48:47.432603 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Flavor limits 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 14:48:47.433023 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Image limits 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 14:48:47.433488 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Flavor pref 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 14:48:47.433891 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Image pref 0:0:0 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 14:48:47.434294 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.virt.hardware [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 14:48:47.444523 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:48:47.444967 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:48:47.445766 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:48:47.446195 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:48:47.462541 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Getting quotas for project 15e58f0cbadf4005bbb5be04e4aef3c1. Resources: {'instances', 'cores', 'ram'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 14:48:47.466080 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.quota [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Getting quotas for user f8e5f3c269d4437c982a5747ddf02d71 and project 15e58f0cbadf4005bbb5be04e4aef3c1. Resources: {'instances', 'cores', 'ram'} {{(pid=116788) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 14:48:47.518552 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Going to run 1 instances... {{(pid=116788) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 14:48:47.520584 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ef0d0596-85d5-46aa-abb0-6ad6319c1a24',volume_size=None,volume_type=None)] {{(pid=116788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 14:48:47.915055 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [52200511-ccd3-44dc-9ee5-b624f2fee019] AMQP server on 10.222.0.82:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 23 14:48:48.932126 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO oslo.messaging._drivers.impl_rabbit [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [52200511-ccd3-44dc-9ee5-b624f2fee019] Reconnected to AMQP server on 10.222.0.82:5672 via [amqp] client with port 34308. Nov 23 14:48:48.935899 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5d82a4f1-9b04-41b6-be8d-682e9682a789 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.976027 Nov 23 14:48:48.936589 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 727/1482] 10.222.0.82 () {60 vars in 1146 bytes} [Tue Nov 23 14:48:46 2021] POST /compute/v2.1/servers => generated 405 bytes in 1978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 14:48:48.945496 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5ebcfe5c-7581-4f9c-af41-5ac71d0118d4] AMQP server on 10.222.0.82:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 23 14:48:48.949340 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-069c8555-a449-4bb8-a8c8-d9eabf971550 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:48:48.950058 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-069c8555-a449-4bb8-a8c8-d9eabf971550 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:48:49.002631 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-069c8555-a449-4bb8-a8c8-d9eabf971550 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:48:49.010868 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-069c8555-a449-4bb8-a8c8-d9eabf971550 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1094 microversion: 2.1 time: 0.068090 Nov 23 14:48:49.011423 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 756/1483] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:48:48 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:48:50.030003 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-757207a2-71ce-43b6-a682-f3168c0ca6c6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:48:50.030615 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-757207a2-71ce-43b6-a682-f3168c0ca6c6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:48:50.082263 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-757207a2-71ce-43b6-a682-f3168c0ca6c6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:48:50.088756 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-757207a2-71ce-43b6-a682-f3168c0ca6c6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1094 microversion: 2.1 time: 0.062226 Nov 23 14:48:50.089301 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 728/1484] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:48:50 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:48:51.105437 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-3005ef19-1bb7-4700-8de5-8671cbeda586 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:48:51.106104 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-3005ef19-1bb7-4700-8de5-8671cbeda586 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:48:51.140301 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO oslo.messaging._drivers.impl_rabbit [-] [5ebcfe5c-7581-4f9c-af41-5ac71d0118d4] Reconnected to AMQP server on 10.222.0.82:5672 via [amqp] client with port 34326. Nov 23 14:48:51.172481 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-3005ef19-1bb7-4700-8de5-8671cbeda586 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:48:51.179459 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-3005ef19-1bb7-4700-8de5-8671cbeda586 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1094 microversion: 2.1 time: 0.077910 Nov 23 14:48:51.180059 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 757/1485] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:48:51 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:48:52.196428 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-8d692536-bf55-43ad-8c05-48057c47218c tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:48:52.197038 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-8d692536-bf55-43ad-8c05-48057c47218c tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:48:52.252466 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-8d692536-bf55-43ad-8c05-48057c47218c tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:48:52.259118 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-8d692536-bf55-43ad-8c05-48057c47218c tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1094 microversion: 2.1 time: 0.066867 Nov 23 14:48:52.259684 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 729/1486] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:48:52 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:48:52.424728 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:48:52.424966 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: Tue Nov 23 14:48:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:48:53.274874 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-7ebffe0e-6e96-4efd-94d0-c0467d9a7504 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:48:53.275481 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-7ebffe0e-6e96-4efd-94d0-c0467d9a7504 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:48:53.282451 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7ebffe0e-6e96-4efd-94d0-c0467d9a7504 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:48:53.282902 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7ebffe0e-6e96-4efd-94d0-c0467d9a7504 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:48:53.283673 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7ebffe0e-6e96-4efd-94d0-c0467d9a7504 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:48:53.284109 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-7ebffe0e-6e96-4efd-94d0-c0467d9a7504 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:48:53.342079 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-7ebffe0e-6e96-4efd-94d0-c0467d9a7504 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:48:53.349600 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-7ebffe0e-6e96-4efd-94d0-c0467d9a7504 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1144 microversion: 2.1 time: 0.078649 Nov 23 14:48:53.350197 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 758/1487] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:48:53 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1144 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:48:54.367287 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a93248ef-d875-4180-b775-cb431790f975 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:48:54.368028 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a93248ef-d875-4180-b775-cb431790f975 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:48:54.375028 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a93248ef-d875-4180-b775-cb431790f975 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:48:54.375468 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a93248ef-d875-4180-b775-cb431790f975 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:48:54.376258 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a93248ef-d875-4180-b775-cb431790f975 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:48:54.376696 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a93248ef-d875-4180-b775-cb431790f975 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:48:54.435400 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a93248ef-d875-4180-b775-cb431790f975 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:48:54.442553 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a93248ef-d875-4180-b775-cb431790f975 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1192 microversion: 2.1 time: 0.079650 Nov 23 14:48:54.443103 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 730/1488] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:48:54 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1192 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:48:55.460828 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c2f41206-1a94-43e5-9faa-731c1f38da1e tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:48:55.461521 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c2f41206-1a94-43e5-9faa-731c1f38da1e tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:48:55.467693 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c2f41206-1a94-43e5-9faa-731c1f38da1e tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:48:55.468271 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c2f41206-1a94-43e5-9faa-731c1f38da1e tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:48:55.469103 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c2f41206-1a94-43e5-9faa-731c1f38da1e tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:48:55.469602 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c2f41206-1a94-43e5-9faa-731c1f38da1e tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:48:55.529561 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c2f41206-1a94-43e5-9faa-731c1f38da1e tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:48:55.536600 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c2f41206-1a94-43e5-9faa-731c1f38da1e tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1210 microversion: 2.1 time: 0.080137 Nov 23 14:48:55.537176 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 759/1489] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:48:55 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:48:56.541564 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-523afad0-6137-499e-8145-71c2fc360778 req-bedc9429-15e2-42ed-85ac-098a2a09b507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c819309-d0d0-4309-b54b-18545f1f4f5e", "tag": "c91dca9d-8b77-447a-ab96-80789e787dfd"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:48:56.545798 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:48:56.545798 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:48:56.553555 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-523afad0-6137-499e-8145-71c2fc360778 req-bedc9429-15e2-42ed-85ac-098a2a09b507 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:48:56.554033 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-523afad0-6137-499e-8145-71c2fc360778 req-bedc9429-15e2-42ed-85ac-098a2a09b507 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:48:56.561122 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a26f973a-ea2f-4c44-93a4-9b265edf26df tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:48:56.561737 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a26f973a-ea2f-4c44-93a4-9b265edf26df tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:48:56.569704 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a26f973a-ea2f-4c44-93a4-9b265edf26df tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:48:56.570204 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a26f973a-ea2f-4c44-93a4-9b265edf26df tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:48:56.570945 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a26f973a-ea2f-4c44-93a4-9b265edf26df tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:48:56.571373 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a26f973a-ea2f-4c44-93a4-9b265edf26df tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:48:56.573831 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-523afad0-6137-499e-8145-71c2fc360778 req-bedc9429-15e2-42ed-85ac-098a2a09b507 service nova] Creating event network-changed:c91dca9d-8b77-447a-ab96-80789e787dfd for instance 4c819309-d0d0-4309-b54b-18545f1f4f5e on hv-cinder-80475 Nov 23 14:48:56.577673 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: ERROR oslo.messaging._drivers.impl_rabbit [req-523afad0-6137-499e-8145-71c2fc360778 req-bedc9429-15e2-42ed-85ac-098a2a09b507 service nova] [70fdbac1-5ff9-4905-b220-28f1f746bdcc] AMQP server on 10.222.0.82:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 23 14:48:56.785908 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-a26f973a-ea2f-4c44-93a4-9b265edf26df tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:48:56.793598 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a26f973a-ea2f-4c44-93a4-9b265edf26df tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1265 microversion: 2.1 time: 0.236272 Nov 23 14:48:56.794322 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 760/1490] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:48:56 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:48:57.593298 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO oslo.messaging._drivers.impl_rabbit [req-523afad0-6137-499e-8145-71c2fc360778 req-bedc9429-15e2-42ed-85ac-098a2a09b507 service nova] [70fdbac1-5ff9-4905-b220-28f1f746bdcc] Reconnected to AMQP server on 10.222.0.82:5672 via [amqp] client with port 34352. Nov 23 14:48:57.596745 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-523afad0-6137-499e-8145-71c2fc360778 req-bedc9429-15e2-42ed-85ac-098a2a09b507 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.059362 Nov 23 14:48:57.597429 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 731/1491] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:48:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:48:57.810616 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-c57b4792-76eb-4c2d-850c-c83573574ae9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:48:57.811222 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-c57b4792-76eb-4c2d-850c-c83573574ae9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:48:57.817365 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c57b4792-76eb-4c2d-850c-c83573574ae9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:48:57.817812 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c57b4792-76eb-4c2d-850c-c83573574ae9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:48:57.818586 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c57b4792-76eb-4c2d-850c-c83573574ae9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:48:57.819131 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-c57b4792-76eb-4c2d-850c-c83573574ae9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:48:58.032610 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-c57b4792-76eb-4c2d-850c-c83573574ae9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:48:58.039959 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-c57b4792-76eb-4c2d-850c-c83573574ae9 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1265 microversion: 2.1 time: 0.233002 Nov 23 14:48:58.040559 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 761/1492] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:48:57 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:48:59.058166 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e262e425-ce06-404b-be1f-993321171bdd tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:48:59.058888 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e262e425-ce06-404b-be1f-993321171bdd tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:48:59.065140 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e262e425-ce06-404b-be1f-993321171bdd tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:48:59.065591 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e262e425-ce06-404b-be1f-993321171bdd tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:48:59.066363 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e262e425-ce06-404b-be1f-993321171bdd tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:48:59.066798 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e262e425-ce06-404b-be1f-993321171bdd tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:48:59.196893 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e262e425-ce06-404b-be1f-993321171bdd tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:48:59.204148 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e262e425-ce06-404b-be1f-993321171bdd tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1265 microversion: 2.1 time: 0.151157 Nov 23 14:48:59.204739 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 732/1493] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:48:59 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:49:00.221954 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-d8031514-7d3c-4663-949f-737b33c0a3b4 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:49:00.222715 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-d8031514-7d3c-4663-949f-737b33c0a3b4 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:49:00.229085 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d8031514-7d3c-4663-949f-737b33c0a3b4 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:00.229544 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d8031514-7d3c-4663-949f-737b33c0a3b4 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:00.230318 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d8031514-7d3c-4663-949f-737b33c0a3b4 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:00.230754 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-d8031514-7d3c-4663-949f-737b33c0a3b4 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:00.365138 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-d8031514-7d3c-4663-949f-737b33c0a3b4 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:49:00.373685 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-d8031514-7d3c-4663-949f-737b33c0a3b4 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1265 microversion: 2.1 time: 0.155354 Nov 23 14:49:00.374252 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 762/1494] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:49:00 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:49:01.390482 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e11564b8-5a38-4917-b6bd-6627cd0399ee tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:49:01.391086 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e11564b8-5a38-4917-b6bd-6627cd0399ee tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:49:01.397443 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e11564b8-5a38-4917-b6bd-6627cd0399ee tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:01.400025 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e11564b8-5a38-4917-b6bd-6627cd0399ee tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:01.400025 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e11564b8-5a38-4917-b6bd-6627cd0399ee tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:01.400025 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e11564b8-5a38-4917-b6bd-6627cd0399ee tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:01.532517 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e11564b8-5a38-4917-b6bd-6627cd0399ee tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:49:01.544042 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e11564b8-5a38-4917-b6bd-6627cd0399ee tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1265 microversion: 2.1 time: 0.153519 Nov 23 14:49:01.544042 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 733/1495] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:49:01 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:49:02.557531 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-84eafd51-4c37-44de-92f1-edff0550a1e8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:49:02.558142 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-84eafd51-4c37-44de-92f1-edff0550a1e8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:49:02.564385 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84eafd51-4c37-44de-92f1-edff0550a1e8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:02.564836 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84eafd51-4c37-44de-92f1-edff0550a1e8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:02.565604 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84eafd51-4c37-44de-92f1-edff0550a1e8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:02.566044 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-84eafd51-4c37-44de-92f1-edff0550a1e8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:02.697808 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-84eafd51-4c37-44de-92f1-edff0550a1e8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:49:02.705394 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-84eafd51-4c37-44de-92f1-edff0550a1e8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1265 microversion: 2.1 time: 0.152129 Nov 23 14:49:02.705953 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 763/1496] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:49:02 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:49:03.722304 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-d42f70c8-4867-4197-86c6-56ff90520ed4 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:49:03.722910 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-d42f70c8-4867-4197-86c6-56ff90520ed4 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:49:03.729233 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d42f70c8-4867-4197-86c6-56ff90520ed4 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:03.729680 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d42f70c8-4867-4197-86c6-56ff90520ed4 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:03.730453 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d42f70c8-4867-4197-86c6-56ff90520ed4 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:03.730885 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-d42f70c8-4867-4197-86c6-56ff90520ed4 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:03.858392 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-d42f70c8-4867-4197-86c6-56ff90520ed4 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:49:03.866904 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-d42f70c8-4867-4197-86c6-56ff90520ed4 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1265 microversion: 2.1 time: 0.147293 Nov 23 14:49:03.867412 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 734/1497] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:49:03 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:49:04.883236 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-fe66f8c2-a748-453a-be68-48a4a97524ae tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:49:04.883847 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-fe66f8c2-a748-453a-be68-48a4a97524ae tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:49:04.890060 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fe66f8c2-a748-453a-be68-48a4a97524ae tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:04.890513 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fe66f8c2-a748-453a-be68-48a4a97524ae tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:04.891288 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fe66f8c2-a748-453a-be68-48a4a97524ae tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:04.891723 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-fe66f8c2-a748-453a-be68-48a4a97524ae tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:05.024607 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-fe66f8c2-a748-453a-be68-48a4a97524ae tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:49:05.031902 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-fe66f8c2-a748-453a-be68-48a4a97524ae tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1265 microversion: 2.1 time: 0.152889 Nov 23 14:49:05.032500 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 764/1498] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:49:04 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:49:06.049458 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-140bd339-cc8f-4693-93c2-c248db32d07b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:49:06.050055 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-140bd339-cc8f-4693-93c2-c248db32d07b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:49:06.056976 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-140bd339-cc8f-4693-93c2-c248db32d07b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:06.057426 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-140bd339-cc8f-4693-93c2-c248db32d07b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:06.058201 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-140bd339-cc8f-4693-93c2-c248db32d07b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:06.058638 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-140bd339-cc8f-4693-93c2-c248db32d07b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:06.186697 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-140bd339-cc8f-4693-93c2-c248db32d07b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:49:06.194766 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-140bd339-cc8f-4693-93c2-c248db32d07b tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1265 microversion: 2.1 time: 0.148216 Nov 23 14:49:06.195444 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 735/1499] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:49:06 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:49:07.212315 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-9d7280a7-c49a-4419-bc75-5d65382b50b6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:49:07.213251 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-9d7280a7-c49a-4419-bc75-5d65382b50b6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:49:07.219388 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9d7280a7-c49a-4419-bc75-5d65382b50b6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:07.219837 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9d7280a7-c49a-4419-bc75-5d65382b50b6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:07.220636 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9d7280a7-c49a-4419-bc75-5d65382b50b6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:07.221074 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-9d7280a7-c49a-4419-bc75-5d65382b50b6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:07.350826 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-9d7280a7-c49a-4419-bc75-5d65382b50b6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:49:07.357964 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-9d7280a7-c49a-4419-bc75-5d65382b50b6 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1265 microversion: 2.1 time: 0.150113 Nov 23 14:49:07.358526 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 765/1500] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:49:07 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:49:08.374925 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-a06e559a-414a-4a69-a49e-f80792696c54 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:49:08.375563 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-a06e559a-414a-4a69-a49e-f80792696c54 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:49:08.382075 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a06e559a-414a-4a69-a49e-f80792696c54 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:08.382528 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a06e559a-414a-4a69-a49e-f80792696c54 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:08.383303 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a06e559a-414a-4a69-a49e-f80792696c54 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:08.383736 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-a06e559a-414a-4a69-a49e-f80792696c54 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:08.518569 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-a06e559a-414a-4a69-a49e-f80792696c54 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:49:08.526311 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-a06e559a-414a-4a69-a49e-f80792696c54 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1265 microversion: 2.1 time: 0.155040 Nov 23 14:49:08.526868 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 736/1501] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:49:08 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:49:09.543461 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-90c9f970-5ccd-4cb3-8971-42ba81e7a85f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:49:09.544051 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-90c9f970-5ccd-4cb3-8971-42ba81e7a85f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:49:09.550216 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-90c9f970-5ccd-4cb3-8971-42ba81e7a85f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:09.550688 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-90c9f970-5ccd-4cb3-8971-42ba81e7a85f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:09.551544 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-90c9f970-5ccd-4cb3-8971-42ba81e7a85f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:09.551977 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-90c9f970-5ccd-4cb3-8971-42ba81e7a85f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:09.685516 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-90c9f970-5ccd-4cb3-8971-42ba81e7a85f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:49:09.692958 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-90c9f970-5ccd-4cb3-8971-42ba81e7a85f tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1265 microversion: 2.1 time: 0.153171 Nov 23 14:49:09.693522 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 766/1502] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:49:09 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:49:09.735925 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-163353a6-2913-499d-89c9-ec2bd853e222 req-2a1b5885-2aff-4886-9f25-7e3d80e8f4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c819309-d0d0-4309-b54b-18545f1f4f5e", "name": "network-vif-plugged", "status": "completed", "tag": "c91dca9d-8b77-447a-ab96-80789e787dfd"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:49:09.737469 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:49:09.737469 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:49:09.746593 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-163353a6-2913-499d-89c9-ec2bd853e222 req-2a1b5885-2aff-4886-9f25-7e3d80e8f4ef service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:09.747033 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-163353a6-2913-499d-89c9-ec2bd853e222 req-2a1b5885-2aff-4886-9f25-7e3d80e8f4ef service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:09.758189 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-163353a6-2913-499d-89c9-ec2bd853e222 req-2a1b5885-2aff-4886-9f25-7e3d80e8f4ef service nova] Creating event network-vif-plugged:c91dca9d-8b77-447a-ab96-80789e787dfd for instance 4c819309-d0d0-4309-b54b-18545f1f4f5e on hv-cinder-80475 Nov 23 14:49:09.763313 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-163353a6-2913-499d-89c9-ec2bd853e222 req-2a1b5885-2aff-4886-9f25-7e3d80e8f4ef service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090567 Nov 23 14:49:09.763986 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 737/1503] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:49:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:49:10.710887 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6a10c83e-6369-4a68-acc8-eb6d6084de84 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:49:10.711497 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6a10c83e-6369-4a68-acc8-eb6d6084de84 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:49:10.717721 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a10c83e-6369-4a68-acc8-eb6d6084de84 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:10.718170 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a10c83e-6369-4a68-acc8-eb6d6084de84 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:10.718948 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a10c83e-6369-4a68-acc8-eb6d6084de84 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:10.719380 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6a10c83e-6369-4a68-acc8-eb6d6084de84 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:10.846951 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6a10c83e-6369-4a68-acc8-eb6d6084de84 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:49:10.854226 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6a10c83e-6369-4a68-acc8-eb6d6084de84 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1265 microversion: 2.1 time: 0.147524 Nov 23 14:49:10.854784 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 767/1504] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:49:10 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:49:11.871600 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-1e3ea324-f87b-438e-bd89-f65a61c156e1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:49:11.872307 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-1e3ea324-f87b-438e-bd89-f65a61c156e1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:49:11.878326 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1e3ea324-f87b-438e-bd89-f65a61c156e1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:11.878771 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1e3ea324-f87b-438e-bd89-f65a61c156e1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:11.879534 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1e3ea324-f87b-438e-bd89-f65a61c156e1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:11.879968 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-1e3ea324-f87b-438e-bd89-f65a61c156e1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:12.010665 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-1e3ea324-f87b-438e-bd89-f65a61c156e1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:49:12.017867 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-1e3ea324-f87b-438e-bd89-f65a61c156e1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1452 microversion: 2.1 time: 0.150407 Nov 23 14:49:12.018433 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 738/1505] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:49:11 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:49:12.034250 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6ccb5683-5b34-4cee-9f2b-f2d141a92bb0 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:49:12.034855 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6ccb5683-5b34-4cee-9f2b-f2d141a92bb0 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:49:12.041811 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6ccb5683-5b34-4cee-9f2b-f2d141a92bb0 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:12.042260 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6ccb5683-5b34-4cee-9f2b-f2d141a92bb0 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:12.043041 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6ccb5683-5b34-4cee-9f2b-f2d141a92bb0 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:12.043488 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6ccb5683-5b34-4cee-9f2b-f2d141a92bb0 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:12.174017 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6ccb5683-5b34-4cee-9f2b-f2d141a92bb0 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:49:12.181180 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6ccb5683-5b34-4cee-9f2b-f2d141a92bb0 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1452 microversion: 2.1 time: 0.150585 Nov 23 14:49:12.181738 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 768/1506] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:49:12 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 14:49:13.778772 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:49:13.779405 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: Tue Nov 23 14:49:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:49:14.393609 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-fd53000e-2b89-4d13-8dfa-676bd062ee66 req-6277a8bf-f71e-4614-b3a3-e657c6182722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c819309-d0d0-4309-b54b-18545f1f4f5e", "tag": "c91dca9d-8b77-447a-ab96-80789e787dfd"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:49:14.395846 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:49:14.395846 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:49:14.403566 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-fd53000e-2b89-4d13-8dfa-676bd062ee66 req-6277a8bf-f71e-4614-b3a3-e657c6182722 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:49:14.404014 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-fd53000e-2b89-4d13-8dfa-676bd062ee66 req-6277a8bf-f71e-4614-b3a3-e657c6182722 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:49:14.415107 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-fd53000e-2b89-4d13-8dfa-676bd062ee66 req-6277a8bf-f71e-4614-b3a3-e657c6182722 service nova] Creating event network-changed:c91dca9d-8b77-447a-ab96-80789e787dfd for instance 4c819309-d0d0-4309-b54b-18545f1f4f5e on hv-cinder-80475 Nov 23 14:49:14.419874 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-fd53000e-2b89-4d13-8dfa-676bd062ee66 req-6277a8bf-f71e-4614-b3a3-e657c6182722 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029973 Nov 23 14:49:14.420594 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 739/1507] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:49:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:50:32.167212 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:50:32.167970 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: Tue Nov 23 14:50:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:51:05.581736 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-a336e3a0-bf2f-4c0f-8f2d-3c7108f4c1ff tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:51:05.582939 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a336e3a0-bf2f-4c0f-8f2d-3c7108f4c1ff tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:51:05.588382 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [req-7216c26c-63a4-4ab0-acd9-3e59e323e26c req-d2289326-4833-4ed4-968c-8e4f8ee3cd8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c819309-d0d0-4309-b54b-18545f1f4f5e", "tag": "c91dca9d-8b77-447a-ab96-80789e787dfd"}]} {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:51:05.589891 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:51:05.589891 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: warnings.warn(msg) Nov 23 14:51:05.590164 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a336e3a0-bf2f-4c0f-8f2d-3c7108f4c1ff tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:05.590794 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a336e3a0-bf2f-4c0f-8f2d-3c7108f4c1ff tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:05.591830 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a336e3a0-bf2f-4c0f-8f2d-3c7108f4c1ff tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:05.592926 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-a336e3a0-bf2f-4c0f-8f2d-3c7108f4c1ff tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:05.598462 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-7216c26c-63a4-4ab0-acd9-3e59e323e26c req-d2289326-4833-4ed4-968c-8e4f8ee3cd8d service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:05.598911 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [req-7216c26c-63a4-4ab0-acd9-3e59e323e26c req-d2289326-4833-4ed4-968c-8e4f8ee3cd8d service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:05.611371 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.compute.server_external_events [req-7216c26c-63a4-4ab0-acd9-3e59e323e26c req-d2289326-4833-4ed4-968c-8e4f8ee3cd8d service nova] Creating event network-changed:c91dca9d-8b77-447a-ab96-80789e787dfd for instance 4c819309-d0d0-4309-b54b-18545f1f4f5e on hv-cinder-80475 Nov 23 14:51:05.617364 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [req-7216c26c-63a4-4ab0-acd9-3e59e323e26c req-d2289326-4833-4ed4-968c-8e4f8ee3cd8d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034533 Nov 23 14:51:05.617975 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 740/1508] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:51:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:51:05.623280 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-a336e3a0-bf2f-4c0f-8f2d-3c7108f4c1ff tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Going to try to terminate instance {{(pid=116787) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:51:05.889576 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-a336e3a0-bf2f-4c0f-8f2d-3c7108f4c1ff tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "DELETE /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 204 len: 0 microversion: 2.1 time: 0.312140 Nov 23 14:51:05.890382 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 769/1509] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:51:05 2021] DELETE /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 14:51:05.898724 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-9ba5ddf7-4cef-450e-8136-a119fb191115 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:51:05.899792 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-9ba5ddf7-4cef-450e-8136-a119fb191115 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:51:05.905994 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9ba5ddf7-4cef-450e-8136-a119fb191115 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:05.909961 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9ba5ddf7-4cef-450e-8136-a119fb191115 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:05.909961 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9ba5ddf7-4cef-450e-8136-a119fb191115 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:05.909961 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-9ba5ddf7-4cef-450e-8136-a119fb191115 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:06.056136 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-9ba5ddf7-4cef-450e-8136-a119fb191115 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:51:06.064513 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-9ba5ddf7-4cef-450e-8136-a119fb191115 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1576 microversion: 2.1 time: 0.169741 Nov 23 14:51:06.068379 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 741/1510] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:51:05 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:51:07.083667 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-6dad7855-df04-4c8e-8ae9-326003390a32 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:51:07.084382 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-6dad7855-df04-4c8e-8ae9-326003390a32 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:51:07.090883 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6dad7855-df04-4c8e-8ae9-326003390a32 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:07.091338 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6dad7855-df04-4c8e-8ae9-326003390a32 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:07.092124 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6dad7855-df04-4c8e-8ae9-326003390a32 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:07.092603 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-6dad7855-df04-4c8e-8ae9-326003390a32 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:07.224522 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-6dad7855-df04-4c8e-8ae9-326003390a32 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:51:07.231839 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-6dad7855-df04-4c8e-8ae9-326003390a32 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1458 microversion: 2.1 time: 0.152231 Nov 23 14:51:07.232446 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 770/1511] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:51:07 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1458 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:51:08.249273 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5985842d-1b2b-4db4-9bd1-0f07d5638055 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:51:08.252827 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5985842d-1b2b-4db4-9bd1-0f07d5638055 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:51:08.256200 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5985842d-1b2b-4db4-9bd1-0f07d5638055 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:08.256695 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5985842d-1b2b-4db4-9bd1-0f07d5638055 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:08.257474 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5985842d-1b2b-4db4-9bd1-0f07d5638055 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:08.257908 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5985842d-1b2b-4db4-9bd1-0f07d5638055 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:08.396544 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-5985842d-1b2b-4db4-9bd1-0f07d5638055 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:51:08.435251 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5985842d-1b2b-4db4-9bd1-0f07d5638055 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1458 microversion: 2.1 time: 0.161938 Nov 23 14:51:08.435251 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 742/1512] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:51:08 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1458 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:51:08.438089 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-f2940d44-d441-4247-b353-49c684ff0d1f req-055fbdba-2afd-475e-94d2-27e9246864b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c819309-d0d0-4309-b54b-18545f1f4f5e", "name": "network-vif-deleted", "tag": "c91dca9d-8b77-447a-ab96-80789e787dfd"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:51:08.439634 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:51:08.439634 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:51:08.446671 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-f2940d44-d441-4247-b353-49c684ff0d1f req-055fbdba-2afd-475e-94d2-27e9246864b5 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:08.447176 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-f2940d44-d441-4247-b353-49c684ff0d1f req-055fbdba-2afd-475e-94d2-27e9246864b5 service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:08.458411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-f2940d44-d441-4247-b353-49c684ff0d1f req-055fbdba-2afd-475e-94d2-27e9246864b5 service nova] Creating event network-vif-deleted:c91dca9d-8b77-447a-ab96-80789e787dfd for instance 4c819309-d0d0-4309-b54b-18545f1f4f5e on hv-cinder-80475 Nov 23 14:51:08.463351 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-f2940d44-d441-4247-b353-49c684ff0d1f req-055fbdba-2afd-475e-94d2-27e9246864b5 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031225 Nov 23 14:51:08.464088 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 771/1513] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:51:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:51:09.424498 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-c781d3ee-0937-43e9-be32-0e3ebfe8ddd1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:51:09.425101 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-c781d3ee-0937-43e9-be32-0e3ebfe8ddd1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:51:09.431573 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c781d3ee-0937-43e9-be32-0e3ebfe8ddd1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:09.432016 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c781d3ee-0937-43e9-be32-0e3ebfe8ddd1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:09.432850 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c781d3ee-0937-43e9-be32-0e3ebfe8ddd1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:09.433435 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c781d3ee-0937-43e9-be32-0e3ebfe8ddd1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:09.464399 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c781d3ee-0937-43e9-be32-0e3ebfe8ddd1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:09.464837 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-c781d3ee-0937-43e9-be32-0e3ebfe8ddd1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:09.465353 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.objects.instance [None req-c781d3ee-0937-43e9-be32-0e3ebfe8ddd1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lazy-loading 'fault' on Instance uuid 4c819309-d0d0-4309-b54b-18545f1f4f5e {{(pid=116788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 14:51:09.551540 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-c781d3ee-0937-43e9-be32-0e3ebfe8ddd1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:51:09.559175 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-c781d3ee-0937-43e9-be32-0e3ebfe8ddd1 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 200 len: 1230 microversion: 2.1 time: 0.138351 Nov 23 14:51:09.559894 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 743/1514] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:51:09 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 1230 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:51:10.579468 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-43953ac8-44e0-4788-a9a6-7824520fed29 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:51:10.580159 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-43953ac8-44e0-4788-a9a6-7824520fed29 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 4c819309-d0d0-4309-b54b-18545f1f4f5e] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:51:10.586186 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-43953ac8-44e0-4788-a9a6-7824520fed29 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:10.586635 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-43953ac8-44e0-4788-a9a6-7824520fed29 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:10.587413 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-43953ac8-44e0-4788-a9a6-7824520fed29 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:10.587923 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-43953ac8-44e0-4788-a9a6-7824520fed29 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:10.600718 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-43953ac8-44e0-4788-a9a6-7824520fed29 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] HTTP exception thrown: Instance 4c819309-d0d0-4309-b54b-18545f1f4f5e could not be found. Nov 23 14:51:10.601323 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-43953ac8-44e0-4788-a9a6-7824520fed29 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Returning 404 to user: Instance 4c819309-d0d0-4309-b54b-18545f1f4f5e could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:51:10.602130 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-43953ac8-44e0-4788-a9a6-7824520fed29 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e" status: 404 len: 111 microversion: 2.1 time: 0.027262 Nov 23 14:51:10.602660 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 772/1515] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:51:10 2021] GET /compute/v2.1/servers/4c819309-d0d0-4309-b54b-18545f1f4f5e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 14:51:13.887154 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-5e07422a-cfea-4a15-913c-6c2e697f4cc7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:51:13.888279 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5e07422a-cfea-4a15-913c-6c2e697f4cc7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:51:13.895616 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5e07422a-cfea-4a15-913c-6c2e697f4cc7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:13.896074 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5e07422a-cfea-4a15-913c-6c2e697f4cc7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:13.896899 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5e07422a-cfea-4a15-913c-6c2e697f4cc7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:13.897385 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-5e07422a-cfea-4a15-913c-6c2e697f4cc7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:13.922662 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-5e07422a-cfea-4a15-913c-6c2e697f4cc7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Going to try to terminate instance {{(pid=116788) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 14:51:13.943236 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-7b86dfcd-955d-4580-8851-9e77650e45bf req-6e1d8a74-7500-411c-a231-afd67845153a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883242e8-f865-41ca-a803-afeb0ebee9ba", "tag": "bd50e621-1d11-484e-b5cb-f16f6dd33499"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:51:13.944860 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:51:13.944860 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:51:13.952923 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-7b86dfcd-955d-4580-8851-9e77650e45bf req-6e1d8a74-7500-411c-a231-afd67845153a service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:13.953374 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-7b86dfcd-955d-4580-8851-9e77650e45bf req-6e1d8a74-7500-411c-a231-afd67845153a service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:13.964465 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-7b86dfcd-955d-4580-8851-9e77650e45bf req-6e1d8a74-7500-411c-a231-afd67845153a service nova] Creating event network-changed:bd50e621-1d11-484e-b5cb-f16f6dd33499 for instance 883242e8-f865-41ca-a803-afeb0ebee9ba on hv-cinder-80475 Nov 23 14:51:13.970050 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-7b86dfcd-955d-4580-8851-9e77650e45bf req-6e1d8a74-7500-411c-a231-afd67845153a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083858 Nov 23 14:51:13.970648 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 773/1516] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:51:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 14:51:14.268295 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-5e07422a-cfea-4a15-913c-6c2e697f4cc7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "DELETE /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 204 len: 0 microversion: 2.1 time: 0.384688 Nov 23 14:51:14.269131 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 744/1517] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:51:13 2021] DELETE /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 14:51:14.277859 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-2f15ca32-68a4-495c-8448-ece8278384d8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:51:14.278090 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-2f15ca32-68a4-495c-8448-ece8278384d8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:51:14.284836 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2f15ca32-68a4-495c-8448-ece8278384d8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:14.285321 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2f15ca32-68a4-495c-8448-ece8278384d8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:14.286102 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2f15ca32-68a4-495c-8448-ece8278384d8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:14.286742 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-2f15ca32-68a4-495c-8448-ece8278384d8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:14.567833 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.policy [None req-2f15ca32-68a4-495c-8448-ece8278384d8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116787) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:51:14.575168 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-2f15ca32-68a4-495c-8448-ece8278384d8 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1579 microversion: 2.1 time: 0.301786 Nov 23 14:51:14.575740 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 774/1518] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:51:14 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1579 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:51:15.592430 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-e64b161f-a709-42a1-afae-f63f60038ac7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:51:15.593115 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-e64b161f-a709-42a1-afae-f63f60038ac7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:51:15.599974 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e64b161f-a709-42a1-afae-f63f60038ac7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:15.600461 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e64b161f-a709-42a1-afae-f63f60038ac7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:15.601237 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e64b161f-a709-42a1-afae-f63f60038ac7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:15.601669 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-e64b161f-a709-42a1-afae-f63f60038ac7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:15.736478 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-e64b161f-a709-42a1-afae-f63f60038ac7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:51:15.744110 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-e64b161f-a709-42a1-afae-f63f60038ac7 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1460 microversion: 2.1 time: 0.155751 Nov 23 14:51:15.744699 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 745/1519] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:51:15 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1460 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:51:16.426838 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [req-afabedbe-c55c-4da7-95da-12f0d21963b0 req-9c79878e-541b-4524-a8b4-85e9b413152d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883242e8-f865-41ca-a803-afeb0ebee9ba", "name": "network-vif-deleted", "tag": "bd50e621-1d11-484e-b5cb-f16f6dd33499"}]} {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 14:51:16.428411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 14:51:16.428411 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: warnings.warn(msg) Nov 23 14:51:16.435538 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-afabedbe-c55c-4da7-95da-12f0d21963b0 req-9c79878e-541b-4524-a8b4-85e9b413152d service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:16.435988 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [req-afabedbe-c55c-4da7-95da-12f0d21963b0 req-9c79878e-541b-4524-a8b4-85e9b413152d service nova] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:16.446704 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.compute.server_external_events [req-afabedbe-c55c-4da7-95da-12f0d21963b0 req-9c79878e-541b-4524-a8b4-85e9b413152d service nova] Creating event network-vif-deleted:bd50e621-1d11-484e-b5cb-f16f6dd33499 for instance 883242e8-f865-41ca-a803-afeb0ebee9ba on hv-cinder-80475 Nov 23 14:51:16.452166 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [req-afabedbe-c55c-4da7-95da-12f0d21963b0 req-9c79878e-541b-4524-a8b4-85e9b413152d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028359 Nov 23 14:51:16.452946 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 775/1520] 10.222.0.82 () {64 vars in 1317 bytes} [Tue Nov 23 14:51:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 14:51:16.761649 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-dd6013ae-21bd-42cd-84a8-4861ae11b6f0 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:51:16.762331 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-dd6013ae-21bd-42cd-84a8-4861ae11b6f0 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:51:16.769817 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dd6013ae-21bd-42cd-84a8-4861ae11b6f0 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:16.770351 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dd6013ae-21bd-42cd-84a8-4861ae11b6f0 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:16.771206 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dd6013ae-21bd-42cd-84a8-4861ae11b6f0 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:16.771729 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-dd6013ae-21bd-42cd-84a8-4861ae11b6f0 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:16.840746 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.policy [None req-dd6013ae-21bd-42cd-84a8-4861ae11b6f0 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e5f3c269d4437c982a5747ddf02d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e58f0cbadf4005bbb5be04e4aef3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116788) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 14:51:16.848483 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-dd6013ae-21bd-42cd-84a8-4861ae11b6f0 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 200 len: 1226 microversion: 2.1 time: 0.090702 Nov 23 14:51:16.849140 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 746/1521] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:51:16 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 14:51:17.865623 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-59221a6c-cdde-45d0-890a-0e1859858b13 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:51:17.866308 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-59221a6c-cdde-45d0-890a-0e1859858b13 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 883242e8-f865-41ca-a803-afeb0ebee9ba] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:51:17.872322 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-59221a6c-cdde-45d0-890a-0e1859858b13 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:17.872773 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-59221a6c-cdde-45d0-890a-0e1859858b13 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:17.873633 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-59221a6c-cdde-45d0-890a-0e1859858b13 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:17.874120 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-59221a6c-cdde-45d0-890a-0e1859858b13 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:17.886573 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-59221a6c-cdde-45d0-890a-0e1859858b13 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] HTTP exception thrown: Instance 883242e8-f865-41ca-a803-afeb0ebee9ba could not be found. Nov 23 14:51:17.887141 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-59221a6c-cdde-45d0-890a-0e1859858b13 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Returning 404 to user: Instance 883242e8-f865-41ca-a803-afeb0ebee9ba could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:51:17.887939 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-59221a6c-cdde-45d0-890a-0e1859858b13 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba" status: 404 len: 111 microversion: 2.1 time: 0.026995 Nov 23 14:51:17.888490 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 776/1522] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:51:17 2021] GET /compute/v2.1/servers/883242e8-f865-41ca-a803-afeb0ebee9ba => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:51:18.375208 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ec61cff5-db8c-4d7a-949f-955cb2a50750 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:51:18.375770 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.compute.api [None req-ec61cff5-db8c-4d7a-949f-955cb2a50750 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116788) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:51:18.382171 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ec61cff5-db8c-4d7a-949f-955cb2a50750 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:18.382611 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ec61cff5-db8c-4d7a-949f-955cb2a50750 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:18.383381 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ec61cff5-db8c-4d7a-949f-955cb2a50750 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:18.383821 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG oslo_concurrency.lockutils [None req-ec61cff5-db8c-4d7a-949f-955cb2a50750 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:18.397214 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.wsgi [None req-ec61cff5-db8c-4d7a-949f-955cb2a50750 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] HTTP exception thrown: Instance 37c522a6-f2da-4126-8472-c685c2422bcd could not be found. Nov 23 14:51:18.397786 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-ec61cff5-db8c-4d7a-949f-955cb2a50750 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Returning 404 to user: Instance 37c522a6-f2da-4126-8472-c685c2422bcd could not be found. {{(pid=116788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:51:18.398598 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-ec61cff5-db8c-4d7a-949f-955cb2a50750 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "DELETE /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 404 len: 111 microversion: 2.1 time: 0.027823 Nov 23 14:51:18.399122 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 747/1523] 10.222.0.82 () {58 vars in 1238 bytes} [Tue Nov 23 14:51:18 2021] DELETE /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:51:18.407569 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-18a18d30-3d2f-440b-b8d6-3bf3ac6450e3 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '>' {{(pid=116787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:51:18.408172 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.compute.api [None req-18a18d30-3d2f-440b-b8d6-3bf3ac6450e3 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] [instance: 37c522a6-f2da-4126-8472-c685c2422bcd] Fetching instance by UUID {{(pid=116787) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 14:51:18.413930 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-18a18d30-3d2f-440b-b8d6-3bf3ac6450e3 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:18.414374 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-18a18d30-3d2f-440b-b8d6-3bf3ac6450e3 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:18.415135 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-18a18d30-3d2f-440b-b8d6-3bf3ac6450e3 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 14:51:18.415564 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG oslo_concurrency.lockutils [None req-18a18d30-3d2f-440b-b8d6-3bf3ac6450e3 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Lock "0b6352a7-9cca-435b-bdd7-4cf12ee239c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 14:51:18.428855 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.wsgi [None req-18a18d30-3d2f-440b-b8d6-3bf3ac6450e3 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] HTTP exception thrown: Instance 37c522a6-f2da-4126-8472-c685c2422bcd could not be found. Nov 23 14:51:18.429419 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: DEBUG nova.api.openstack.wsgi [None req-18a18d30-3d2f-440b-b8d6-3bf3ac6450e3 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Returning 404 to user: Instance 37c522a6-f2da-4126-8472-c685c2422bcd could not be found. {{(pid=116787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 14:51:18.430206 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO nova.api.openstack.requestlog [None req-18a18d30-3d2f-440b-b8d6-3bf3ac6450e3 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd" status: 404 len: 111 microversion: 2.1 time: 0.026936 Nov 23 14:51:18.430706 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: [pid: 116787|app: 0|req: 777/1524] 10.222.0.82 () {58 vars in 1235 bytes} [Tue Nov 23 14:51:18 2021] GET /compute/v2.1/servers/37c522a6-f2da-4126-8472-c685c2422bcd => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 14:51:19.889533 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: DEBUG nova.api.openstack.wsgi [None req-f7022d03-5e42-4ffd-bd79-bd5e8fe74310 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] Calling method '.version_select at 0x7f20880dd8b0>' {{(pid=116788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 14:51:19.972086 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO nova.api.openstack.requestlog [None req-f7022d03-5e42-4ffd-bd79-bd5e8fe74310 tempest-TestVolumeBootPattern-727734966 tempest-TestVolumeBootPattern-727734966-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1535281038" status: 202 len: 0 microversion: 2.1 time: 0.086184 Nov 23 14:51:19.972726 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: [pid: 116788|app: 0|req: 748/1525] 10.222.0.82 () {58 vars in 1262 bytes} [Tue Nov 23 14:51:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1535281038 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 14:51:58.731383 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:51:58.731986 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: Tue Nov 23 14:51:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:53:50.717987 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:53:50.718586 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: Tue Nov 23 14:53:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:53:52.185042 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:53:52.185651 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: Tue Nov 23 14:53:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:53:52.444372 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:53:52.444850 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: Tue Nov 23 14:53:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:53:58.500038 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:53:58.500744 dv-cinder-804757-10-iscsi devstack@n-api.service[116788]: Tue Nov 23 14:53:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:54:13.798365 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:54:13.798937 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: Tue Nov 23 14:54:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 14:55:18.749212 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 14:55:18.749901 dv-cinder-804757-10-iscsi devstack@n-api.service[116787]: Tue Nov 23 14:55:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!